[jira] [Resolved] (ACCUMULO-3327) tablet server re-reads the bulk loaded flags with every bulk import request

["Eric Newton (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ACCUMULO-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Newton resolved ACCUMULO-3327.
-----------------------------------
    Resolution: Fixed

Makes bulk import about 50% faster, too.  I'm thinking this should be cherry picked back to 1.7.

> tablet server re-reads the bulk loaded flags with every bulk import request
> ---------------------------------------------------------------------------
>
>                 Key: ACCUMULO-3327
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3327
>             Project: Accumulo
>          Issue Type: Sub-task
>          Components: tserver
>    Affects Versions: 1.5.1, 1.6.0, 1.6.1
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.8.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> On a very large cluster, which bulk loads many thousands of files every few minutes, I noticed the servers would reload the bulk imported flags with every request.  This put a lot of pressure on the accumulo.metadata table, and it just isn't necessary: the tablet should be tracking which bulk import files it has loaded, except when it first loaded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)