You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2020/08/10 07:39:18 UTC

[GitHub] [beam] piotr-szuberski edited a comment on pull request #11749: [BEAM-9977] Implement ReadFromKafkaViaSDF

piotr-szuberski edited a comment on pull request #11749:
URL: https://github.com/apache/beam/pull/11749#issuecomment-671207252


   @boyuanzz This change has broken python postcommits that run kafka cross-language it tests.
   
   Could you take a look on that? I tried to fix it but it seems it would take me a lot of time since I'm not familiar with those SDF changes - it's possible that it's something straightforward. I tried to remove --experiments=beam_fn_api to run cross-language tests with deprecated transforms without SDF, but without luck.
   
   A stacktrace fragment:
   ```
   Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction 2: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Could not find a way to create AutoValue class class org.apache.beam.sdk.io.kafka.KafkaSourceDescriptor
   	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
   	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
   	at org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient.awaitCompletion(CompletableFutureInboundDataClient.java:48)
   	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:91)
   	at org.apache.beam.fn.harness.BeamFnDataReadRunner.blockTillReadFinishes(BeamFnDataReadRunner.java:342)
   	at org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:108)
   	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:302)
   	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
   	at org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org