[jira] [Commented] (BEAM-1531) Support dynamic work rebalancing for HBaseIO

["Jingsong Lee (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066883#comment-16066883 ] 

Jingsong Lee commented on BEAM-1531:
------------------------------------

Hi [~iemejia]l, at BEAM-2393 we talked about accelerating HBaseIOTest.
Since some tests (including {{testReadingSplitAtFraction}}) only use the Scanner.iterator interface, so I abstracted the iterator interface, so use memory queries to speed up the test.
I did not abstract the estimateSizeBytes and split, that would be a bit more complicated.
Commit: https://github.com/JingsongLi/beam/commit/d1080c2a1669d13654f64b77122f7cfcb6e1edeb
What do you think?

> Support dynamic work rebalancing for HBaseIO
> --------------------------------------------
>
>                 Key: BEAM-1531
>                 URL: https://issues.apache.org/jira/browse/BEAM-1531
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Ismaël Mejía
>            Assignee: Ismaël Mejía
>            Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)