You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/30 18:11:44 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #291
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/291/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-12951]: Create initial structure for Playground application
[rohde.samuel] Fix BEAM-12984
[noreply] Update Beam glossary (#15619)
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633025498.9260902_fe28053c-c519-4ea5-b6fb-ca8c4ca5847e.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_a0ec1113-e7fb-4ff2-a360-f3eaeb101106.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_a0ec1113-e7fb-4ff2-a360-f3eaeb101106.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_a0ec1113-e7fb-4ff2-a360-f3eaeb101106.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_a0ec1113-e7fb-4ff2-a360-f3eaeb101106.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633025499.2796912_9f14ffbb-1257-4db0-a181-4cb8d471b2c2
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633025499.2796912_9f14ffbb-1257-4db0-a181-4cb8d471b2c2.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 69.13 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 9s
66 actionable tasks: 45 executed, 21 from cache
Publishing build scan...
https://gradle.com/s/ikkwuipuniajg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Samza
#309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/309/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/308/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15618 from [BEAM-12968] [Playground] Create README
[noreply] Merge pull request #15626 from [BEAM-12963] [Playground] Create base
[noreply] Merge pull request #15566 from [BEAM-12925] Correct behavior retrieving
[noreply] [BEAM-12911] Update schema translation (Java, Python) to log more
[noreply] Update CHANGES.md for JdbcIO breaking change (#15651)
[noreply] [BEAM-12513] Add Go SDK metrics content to BPG. (#15650)
[noreply] [BEAM-12996] Improve Error Logging in ConfigBuilder (#15646)
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633393292.424646_0b71ad4e-f39f-4889-a03a-aeab4a7e9fb2.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_0a25d418-0b3e-4421-a626-1009ab0e21da.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_0a25d418-0b3e-4421-a626-1009ab0e21da.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_0a25d418-0b3e-4421-a626-1009ab0e21da.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_0a25d418-0b3e-4421-a626-1009ab0e21da.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633393292.7630796_87d33929-4987-456a-8c24-ab4934b4dc3f
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633393292.7630796_87d33929-4987-456a-8c24-ab4934b4dc3f.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 61.59 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 56s
66 actionable tasks: 45 executed, 21 from cache
Publishing build scan...
https://gradle.com/s/bjphlycb622lw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/307/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11516] Upgrade to pylint 2.11.1, fix warnings (#15612)
[noreply] [BEAM-12979, BEAM-11097] Change cache to store ReStreams, clean up to…
[noreply] [BEAM-3304, BEAM-12513] Trigger changes and Windowing. (#15644)
------------------------------------------
[...truncated 3.03 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633371042.1640692_906e026a-c2f4-44fe-99e0-e137be658208.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633371042.4542806_73136856-d62c-4567-ab2a-63b149b4999d
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633371042.4542806_73136856-d62c-4567-ab2a-63b149b4999d.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 74.36 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 15s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/qwenkynl5scd2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/306/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633349328.3275442_7eb86eb2-955c-4eb1-976a-ff94872c9a35.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_931bee59-7e14-44e1-b256-318bb66574ba.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_931bee59-7e14-44e1-b256-318bb66574ba.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_931bee59-7e14-44e1-b256-318bb66574ba.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_931bee59-7e14-44e1-b256-318bb66574ba.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633349328.645207_9420d6b2-eb93-47e3-8a6c-b85048cb9908
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633349328.645207_9420d6b2-eb93-47e3-8a6c-b85048cb9908.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 77.67 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 17s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/r2iung2szlltc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/305/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633327655.7079155_b5e82f3b-be05-4d77-a886-b01a3afb0663.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633327656.0016282_888390fe-a1b8-499f-88c1-3b9dd5029b4e
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633327656.0016282_888390fe-a1b8-499f-88c1-3b9dd5029b4e.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 60.75 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/4kr2zlt55alty
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #304
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/304/display/redirect>
Changes:
------------------------------------------
[...truncated 3.06 MB...]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633306261.2036214_40008827-f19c-4e6e-8423-07afdce51ca4.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
[grpc-default-executor-1] ERROR org.apache.beam.runners.jobsubmission.InMemoryJobService - Encountered Unexpected Exception for Invocation test_windowing_1633306261.2036214_40008827-f19c-4e6e-8423-07afdce51ca4
java.lang.IllegalStateException: Stream is already completed, no further calls are allowed
at org.apache.beam.vendor.grpc.v1p36p0.com.google.common.base.Preconditions.checkState(Preconditions.java:508)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onNext(ServerCalls.java:360)
at org.apache.beam.sdk.fn.stream.SynchronizedStreamObserver.onNext(SynchronizedStreamObserver.java:46)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$getMessageStream$2(InMemoryJobService.java:434)
at org.apache.beam.runners.jobsubmission.JobInvocation.addStateListener(JobInvocation.java:218)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.getMessageStream(InMemoryJobService.java:450)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:972)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:797)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Oct 04, 2021 12:11:01 AM org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1a81a849
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p36p0.com.google.common.base.Preconditions.checkState(Preconditions.java:508)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:209)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:202)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onError(ServerCalls.java:374)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.getMessageStream(InMemoryJobService.java:458)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:972)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:797)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_32435fed-674d-4ede-a50a-5db3e392fae4.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_32435fed-674d-4ede-a50a-5db3e392fae4.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_32435fed-674d-4ede-a50a-5db3e392fae4.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_32435fed-674d-4ede-a50a-5db3e392fae4.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633306261.7813234_f67eb973-7022-4992-a613-e4e3afba9dd4
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633306261.7813234_f67eb973-7022-4992-a613-e4e3afba9dd4.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
======== 29 failed, 7 passed, 14 skipped, 1 warnings in 126.62 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 33s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/wsrxai44lppok
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #303
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/303/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633284455.1724737_5689181c-5a60-427a-8211-84205dda9e82.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_303f0ee7-aa70-4623-8b2e-eb51fcc8f18b.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_303f0ee7-aa70-4623-8b2e-eb51fcc8f18b.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_303f0ee7-aa70-4623-8b2e-eb51fcc8f18b.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_303f0ee7-aa70-4623-8b2e-eb51fcc8f18b.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633284455.4530394_bbd5cab0-44c8-45d4-ad39-3e67a53d27ba
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633284455.4530394_bbd5cab0-44c8-45d4-ad39-3e67a53d27ba.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 60.56 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/xx3ncgkhaq4ga
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #302
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/302/display/redirect>
Changes:
------------------------------------------
[...truncated 3.04 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633263717.0143375_422848fe-25db-49a1-b6fb-ee2f315424d0.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_3c047e4a-351c-4b74-8cb7-e8730d5965a5.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_3c047e4a-351c-4b74-8cb7-e8730d5965a5.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_3c047e4a-351c-4b74-8cb7-e8730d5965a5.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_3c047e4a-351c-4b74-8cb7-e8730d5965a5.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633263717.6041312_7470e205-d0da-4fe3-90a8-0dafd5bb66be
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633263717.6041312_7470e205-d0da-4fe3-90a8-0dafd5bb66be.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 98.99 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 0s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/zdolzhc7uwzle
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #301
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/301/display/redirect>
Changes:
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633241330.3741074_6a694e95-8248-4afb-bac3-88dfbf201b35.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_40693e08-23f5-4d6e-9a34-9b036a556773.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_40693e08-23f5-4d6e-9a34-9b036a556773.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_40693e08-23f5-4d6e-9a34-9b036a556773.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_40693e08-23f5-4d6e-9a34-9b036a556773.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633241330.6869483_3f30a8cd-b10c-4a5c-8e08-f46661d1bf49
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633241330.6869483_3f30a8cd-b10c-4a5c-8e08-f46661d1bf49.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 81.34 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 22s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/ylpioi2theumm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #300
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/300/display/redirect>
Changes:
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633219736.1997895_ad25eafd-3c95-403e-8367-85d22e503b84.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_dbc71a49-f299-415d-b6a1-33eb0b9a14b4.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_dbc71a49-f299-415d-b6a1-33eb0b9a14b4.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_dbc71a49-f299-415d-b6a1-33eb0b9a14b4.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_dbc71a49-f299-415d-b6a1-33eb0b9a14b4.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633219736.5515325_5cc3a1b3-9a5b-4bd5-8304-ee131b8da9fa
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633219736.5515325_5cc3a1b3-9a5b-4bd5-8304-ee131b8da9fa.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 67.45 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 28s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/gkgrixixqjlw6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #299
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/299/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633198147.8926861_cc833f32-d0c4-4d59-ac17-bf363d22271c.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_d35bba44-da7b-4ca1-aeba-3a3de362fbcb.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_d35bba44-da7b-4ca1-aeba-3a3de362fbcb.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_d35bba44-da7b-4ca1-aeba-3a3de362fbcb.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_d35bba44-da7b-4ca1-aeba-3a3de362fbcb.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633198148.214601_ab57c959-3697-4def-9563-d71d3cb96e81
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633198148.214601_ab57c959-3697-4def-9563-d71d3cb96e81.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 83.98 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 41s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/ewgw455npiv72
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #298
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/298/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633176550.3596206_c5390d43-fe51-4c91-8f1a-e918e398414d.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_90f5c1e8-dcea-443e-87bb-f2bffac15cba.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_90f5c1e8-dcea-443e-87bb-f2bffac15cba.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_90f5c1e8-dcea-443e-87bb-f2bffac15cba.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_90f5c1e8-dcea-443e-87bb-f2bffac15cba.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633176550.690305_afffff52-c312-4f06-a6e7-0ab70d78f164
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633176550.690305_afffff52-c312-4f06-a6e7-0ab70d78f164.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 77.42 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 43s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/orjdxhzds3xny
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/297/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12513] Schemas and Coders (#15632)
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633154923.798456_f1860ce9-7f1b-46ca-bf92-53ab6a5f6389.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_ea20f9a2-212f-47f4-8eb0-ae34669552ca.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_ea20f9a2-212f-47f4-8eb0-ae34669552ca.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_ea20f9a2-212f-47f4-8eb0-ae34669552ca.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_ea20f9a2-212f-47f4-8eb0-ae34669552ca.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633154924.1521196_357fe670-1f9f-4d7b-b630-7b1dfc05ff4e
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633154924.1521196_357fe670-1f9f-4d7b-b630-7b1dfc05ff4e.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 72.93 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 16s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/uuul5ljpipw7k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/296/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11217] Implemented metrics filtering (#15482)
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633133276.1114976_493b3711-df53-4b1d-930e-a6477f7ea8ce.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_c1318685-a657-4871-b49c-cecd9dedba74.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_c1318685-a657-4871-b49c-cecd9dedba74.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_c1318685-a657-4871-b49c-cecd9dedba74.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_c1318685-a657-4871-b49c-cecd9dedba74.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633133276.4894202_c76ca08a-9059-4b10-819c-aa88cb637d9e
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633133276.4894202_c76ca08a-9059-4b10-819c-aa88cb637d9e.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 72.15 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 29s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/6sz6gw4wlavaw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/295/display/redirect?page=changes>
Changes:
[noreply] Switching to innerText and removing alerts
[noreply] [BEAM-12993] Update to Debezium 1.7.0.Final (#15636)
[noreply] Minor: Fix `Iterable[SplitResultResidual]` type errors (#15634)
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633111673.0355625_1895706c-fe5b-4ed6-bd53-2823868612da.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_9552e4f7-3cd1-4135-ad4f-1c8252413406.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_9552e4f7-3cd1-4135-ad4f-1c8252413406.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_9552e4f7-3cd1-4135-ad4f-1c8252413406.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_9552e4f7-3cd1-4135-ad4f-1c8252413406.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633111673.353326_4533315f-2b55-4568-8e61-ab05d6d0b3fa
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633111673.353326_4533315f-2b55-4568-8e61-ab05d6d0b3fa.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 66.43 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 14s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/fsxzkx7cfd56m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #294
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/294/display/redirect>
Changes:
------------------------------------------
[...truncated 3.05 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633090393.8139474_8cf4a7ee-d74a-4890-a471-4052ce3bb8bd.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_b9d32d3f-8c11-4579-8e1b-6711ba4681e3.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_b9d32d3f-8c11-4579-8e1b-6711ba4681e3.ref_Environment_default_environment_1.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_b9d32d3f-8c11-4579-8e1b-6711ba4681e3.null.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_b9d32d3f-8c11-4579-8e1b-6711ba4681e3.
[grpc-default-executor-2] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633090394.2852964_8d8de42e-a98a-47b0-a645-d2ee73637645
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633090394.2852964_8d8de42e-a98a-47b0-a645-d2ee73637645.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
======== 29 failed, 7 passed, 14 skipped, 1 warnings in 114.07 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 45s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/7hnm6ph2u6smg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #293
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/293/display/redirect?page=changes>
Changes:
[noreply] [BEAM-9918] Make TryCrossLanguage match non Try API (#15633)
[noreply] [BEAM-12957] Add support for pyarrow 5.x (#15588)
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633068593.814668_5fa1fbb9-250e-4cea-9fab-8b0be282e2d2.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_4509d84b-56a8-49a5-b72b-3ed26fa8b124.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_4509d84b-56a8-49a5-b72b-3ed26fa8b124.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_4509d84b-56a8-49a5-b72b-3ed26fa8b124.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_4509d84b-56a8-49a5-b72b-3ed26fa8b124.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633068594.1787426_423d9a23-a4a5-4b7e-ad88-742f7d91b72d
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633068594.1787426_423d9a23-a4a5-4b7e-ad88-742f7d91b72d.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 81.78 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 23s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/p2bj7oksg5uj6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #292
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/292/display/redirect?page=changes>
Changes:
[dpcollins] [BEAM-12908] Change to use PubsubSignal for information propagation so
[Robert Bradshaw] Preserve more types in transform replacement.
[Robert Bradshaw] Update test to reflect preserved type hint.
[noreply] [BEAM-11985] Python Bigtable - Implement IO Request Count metrics
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633046980.0888796_d516c447-eded-457a-8083-80fcff2a2ec0.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_b31f69f9-a94d-418a-8672-c21ced0c3477.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_b31f69f9-a94d-418a-8672-c21ced0c3477.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_b31f69f9-a94d-418a-8672-c21ced0c3477.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_b31f69f9-a94d-418a-8672-c21ced0c3477.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633046980.4397671_dfe60c4f-d3ff-4707-b8a7-9517a263a9c2
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633046980.4397671_dfe60c4f-d3ff-4707-b8a7-9517a263a9c2.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 61.17 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 21s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/hqblf6yyetbcw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org