You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "m0hit-aggarwal (via GitHub)" <gi...@apache.org> on 2023/05/31 09:06:31 UTC

[GitHub] [beam] m0hit-aggarwal opened a new issue, #26945: [Feature Request]: Ability to register translators with Flink Runners

m0hit-aggarwal opened a new issue, #26945:
URL: https://github.com/apache/beam/issues/26945

   ### What would you like to happen?
   
   Currently the implementation for FlinkRunner is in a manner that it doesn't allow adding new translators for outside of the class **FlinkStreamingTransformTranslators**. There is a private TRANSLATORS hashmap which cannot be accessed outside of the class and the class doesn't expose any method to add a translator to that hashmap. This restricts the ability to add some custom translator to Flink runner unless someone makes changes to FlinkStreamingTransformTranslators class.
   
   Other runners like DataflowRunner has exposed such methods like **DataflowPipelineTranslator.registerTransformTranslator()** which gives such functionality.
   
   Can we have expose some methods in Flink Runner which gives this functionality or is there a particular reason Flink Runner has been implemented in such a way ? 
    
   
   ### Issue Priority
   
   Priority: 2 (default / most feature requests should be filed as P2)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [X] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org