You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Adam Fuchs (JIRA)" <ji...@apache.org> on 2013/10/07 19:35:47 UTC

[jira] [Created] (ACCUMULO-1755) BatchWriter blocks all addMutation calls while binning mutations

Adam Fuchs created ACCUMULO-1755:
------------------------------------

             Summary: BatchWriter blocks all addMutation calls while binning mutations
                 Key: ACCUMULO-1755
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1755
             Project: Accumulo
          Issue Type: Improvement
          Components: client
            Reporter: Adam Fuchs


Through code inspection, we found that the BatchWriter bins mutations inside of a synchronized block that covers calls to addMutation. Binning potentially involves lookups of tablet metadata and processes a fair amount of information. We will get better parallelism if we can either unlock the lock while binning, dedicate another thread to do the binning, or use one of the send threads to do the binning.

This has not been verified empirically yet, so there is not yet any profiling info to indicate the level of improvement that we should expect. Profiling and repeatable demonstration of this performance bottleneck should be the first step on this ticket.



--
This message was sent by Atlassian JIRA
(v6.1#6144)