[jira] [Comment Edited] (BEAM-10663) CrossLanguageKafkaIOTest broken on Flink Runner

["Boyuan Zhang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303613#comment-17303613 ] 

Boyuan Zhang edited comment on BEAM-10663 at 3/17/21, 5:37 PM:
---------------------------------------------------------------

I don't think this test will be broken owing to https://issues.apache.org/jira/browse/BEAM-11998 because it specifies max_num_records, which in java the read goes through a composite transform BoundedReadFromUnboundedSource. It will not go through SDF code path.


was (Author: boyuanz):
I don't think this test will be broken owing to https://issues.apache.org/jira/browse/BEAM-11998 because it specifies max_num_records, which in java the read goes through BoundedReadFromUnboundedSource, which is a composite transform. It will not go through SDF code path.

> CrossLanguageKafkaIOTest broken on Flink Runner
> -----------------------------------------------
>
>                 Key: BEAM-10663
>                 URL: https://issues.apache.org/jira/browse/BEAM-10663
>             Project: Beam
>          Issue Type: Bug
>          Components: cross-language, io-py-kafka, test-failures
>    Affects Versions: 2.24.0
>            Reporter: Piotr Szuberski
>            Assignee: Brian Hulette
>            Priority: P1
>          Time Spent: 6h 40m
>  Remaining Estimate: 0h
>
> Python postcommits fail on CrossLanguageKafkaIO python tests after #11749 (BEAM-9977) merge.
>  
> Fragment of stackstrace:
> ```
> {{Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction 2: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Could not find a way to create AutoValue class class org.apache.beam.sdk.io.kafka.KafkaSourceDescriptor
> 	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 	at org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient.awaitCompletion(CompletableFutureInboundDataClient.java:48)
> 	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:91)
> 	at org.apache.beam.fn.harness.BeamFnDataReadRunner.blockTillReadFinishes(BeamFnDataReadRunner.java:342)
> 	at org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:108)
> 	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:302)
> 	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
> 	at org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:748)}}
> ```



--
This message was sent by Atlassian Jira
(v8.3.4#803005)