[GitHub] [beam] aditiwari01 commented on issue #20530: Make non-portable Splittable DoFn the only option when executing Java "Read" transforms

["aditiwari01 (via GitHub)" <gi...@apache.org>]

aditiwari01 commented on issue #20530:
URL: https://github.com/apache/beam/issues/20530#issuecomment-1504760474

   Hi @damccorm 
   
   I was trying KafkaIO with FlinkRunner but facing following issue:
   
   ```
   Exception in thread "main" java.lang.IllegalStateException: No translator known for org.apache.beam.runners.core.construction.SplittableParDo$PrimitiveUnboundedRead
   	at org.apache.beam.runners.core.construction.PTransformTranslation.urnForTransform(PTransformTranslation.java:283)
   	at org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.visitPrimitiveTransform(FlinkStreamingPipelineTranslator.java:135)
   	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:593)
   	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:585)
   	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:585)
   	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:585)
   	at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$500(TransformHierarchy.java:240)
   	at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:214)
   	at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:469)
   	at org.apache.beam.runners.flink.FlinkPipelineTranslator.translate(FlinkPipelineTranslator.java:38)
   	at org.apache.beam.runners.flink.FlinkStreamingPipelineTranslator.translate(FlinkStreamingPipelineTranslator.java:92)
   	at org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.translate(FlinkPipelineExecutionEnvironment.java:115)
   	at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:105)
   	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:323)
   	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:309)
   	at BeamPipelineKafka.main(BeamPipelineKafka.java:54)
   ```
   
   As you mentioned all the runners are capable of Splittable DoFn, is there anything I am missing?
   
   I have also tried with `"--experiments=use_deprecated_read"` to use primitive read but still facing same issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org