You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Corey J. Nolet (JIRA)" <ji...@apache.org> on 2014/12/18 04:33:13 UTC
[jira] [Updated] (ACCUMULO-3033) SiteConfiguration gets invoked
frequently and scans all configuration items
[ https://issues.apache.org/jira/browse/ACCUMULO-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Corey J. Nolet updated ACCUMULO-3033:
-------------------------------------
Fix Version/s: (was: 1.6.2)
1.6.3
> SiteConfiguration gets invoked frequently and scans all configuration items
> ---------------------------------------------------------------------------
>
> Key: ACCUMULO-3033
> URL: https://issues.apache.org/jira/browse/ACCUMULO-3033
> Project: Accumulo
> Issue Type: Improvement
> Affects Versions: 1.5.0, 1.5.1, 1.6.0
> Reporter: Josh Elser
> Assignee: Josh Elser
> Fix For: 1.5.3, 1.7.0, 1.6.3
>
>
> I noticed yesterday that {{SiteConfiguration#getProperties(Map, PropertyFilter)}} is invoked very frequently (at least 30 times a second on my single machine) to extract the Iterator configurations before a table scan happens. Printing a stack trace shows that this is the dominating caller of {{getProperties}} is {{IteratorUtil#parseIterConf()}}.
> What this translates to is repeatedly reading, filtering and adding the same elements to a map to satisfy the {{AccumuloConfiguration#getPropertiesWithPrefix}} from an immutable source (accumulo-site.xml). While this is probably not a huge time waste in terms of actual time spent, it's repeatedly happening and will slow things down (especially when the underlying Hadoop Configuration is creating a new HashMap with the contents of the accumulo-site.xml for every call).
> Need to think about some options for making the "extract keys with this prefix" case faster from SiteConfiguration.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)