You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Solomon Duskis (JIRA)" <ji...@apache.org> on 2017/11/24 17:55:00 UTC

[jira] [Created] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

Solomon Duskis created BEAM-3246:
------------------------------------

             Summary: BigtableIO should merge splits if they exceed 15K
                 Key: BEAM-3246
                 URL: https://issues.apache.org/jira/browse/BEAM-3246
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-gcp
            Reporter: Solomon Duskis
            Assignee: Solomon Duskis


A customer hit a problem with a large number of splits.  CloudBitableIO fixes that here https://github.com/GoogleCloudPlatform/cloud-bigtable-client/blob/master/bigtable-dataflow-parent/bigtable-hbase-beam/src/main/java/com/google/cloud/bigtable/beam/CloudBigtableIO.java#L241

BigtableIO should have similar logic.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)