You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Eric Newton (JIRA)" <ji...@apache.org> on 2015/10/20 22:16:27 UTC
[jira] [Resolved] (ACCUMULO-4021) bulk imports slow file garbage
collection
[ https://issues.apache.org/jira/browse/ACCUMULO-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Newton resolved ACCUMULO-4021.
-----------------------------------
Resolution: Fixed
> bulk imports slow file garbage collection
> -----------------------------------------
>
> Key: ACCUMULO-4021
> URL: https://issues.apache.org/jira/browse/ACCUMULO-4021
> Project: Accumulo
> Issue Type: Bug
> Components: gc
> Affects Versions: 1.6.3
> Environment: large production system
> Reporter: Eric Newton
> Assignee: Eric Newton
> Fix For: 1.6.5, 1.7.1, 1.8.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> On a large system, bulk imports slow file garbage collection to a crawl. The total number of files to be deleted was about 14 million. Initially, it would run quickly, but then slow down, to the point where only a few files would be deleted every few minutes. The jvm was only using 50% of the CPU (and therefore, probably not GC thrashing). JStacks showed the collector scanning the metadata table to remove referenced files from the delete list.
> If the bulk ingest requests were stopped, the GC completed quickly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)