You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 21:54:55 UTC

[GitHub] [beam] kennknowles opened a new issue, #18981: Make HBaseIO.read() based on SDF by default

kennknowles opened a new issue, #18981:
URL: https://github.com/apache/beam/issues/18981

   BEAM-4020 introduces HBaseIO reads based on SDF. So far the read() method still uses the Source based API because SDF does not support Dynamic Work Rebalancing (DWR) but the Source API of HBase does, so changing it means losing some functionality.
   
   Since DWR is only supported by Dataflow once Dataflow supports SDF  **** DWR we can move the main read() function to use the SDF API and remove the Source based implementation. The rest of the runners already support Bounded based Reads (like HBase based on SDF does) via a default translation without DWR.
   
   Imported from Jira [BEAM-4735](https://issues.apache.org/jira/browse/BEAM-4735). Original Jira may contain additional context.
   Reported by: iemejia.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org