You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/06/03 21:55:01 UTC

[jira] [Commented] (BEAM-4735) Make HBaseIO.read() based on SDF by default

    [ https://issues.apache.org/jira/browse/BEAM-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17547213#comment-17547213 ] 

Kenneth Knowles commented on BEAM-4735:
---------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/18981

> Make HBaseIO.read() based on SDF by default
> -------------------------------------------
>
>                 Key: BEAM-4735
>                 URL: https://issues.apache.org/jira/browse/BEAM-4735
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-hbase
>            Reporter: Ismaël Mejía
>            Priority: P3
>
> BEAM-4020 introduces HBaseIO reads based on SDF. So far the read() method still uses the Source based API because SDF does not support Dynamic Work Rebalancing (DWR) but the Source API of HBase does, so changing it means losing some functionality.
> Since DWR is only supported by Dataflow once Dataflow supports SDF  + DWR we can move the main read() function to use the SDF API and remove the Source based implementation. The rest of the runners already support Bounded based Reads (like HBase based on SDF does) via a default translation without DWR.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)