You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Keith Turner (JIRA)" <ji...@apache.org> on 2017/12/01 18:28:00 UTC
[jira] [Assigned] (ACCUMULO-4743) Use tserver prefix for Cache
config instead of general custom
[ https://issues.apache.org/jira/browse/ACCUMULO-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Keith Turner reassigned ACCUMULO-4743:
--------------------------------------
Assignee: Jared R
> Use tserver prefix for Cache config instead of general custom
> -------------------------------------------------------------
>
> Key: ACCUMULO-4743
> URL: https://issues.apache.org/jira/browse/ACCUMULO-4743
> Project: Accumulo
> Issue Type: Bug
> Reporter: Keith Turner
> Assignee: Jared R
> Labels: pull-request-available
> Fix For: 2.0.0
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> In ACCUMULO-4463 caching implementations were made configurable. At the time config for a cache was placed under the {{general.custom.cache}} prefix. The idea was that a cache impl would be passed in a AccumuloConfiguration object and it could grab whatever it wanted from {{general.custom.cache}}.
> In ACCUMULO-4644 the cache API was changed to not use AccumuloConfiguration because that type is not in the public API. This removed the reason for using general.custom in the first place.
> When trying to implement an external cache I discovered that I can not set general.custom props in zookeeper. However the cache class is a tserver prefixed property can can be set in zookeeper. For the [accumulo-ohc|https://github.com/keith-turner/accumulo-ohc] I wanted to do the following in the shell but could not set the general props.
> {noformat}
> config -s general.custom.cache.ohc.data.on-heap.maximumWeight=1000000000
> config -s general.custom.cache.ohc.data.off-heap.capacity=10000000000
> config -s tserver.cache.manager.class=accumulo.ohc.OhcCacheManager
> {noformat}
> I think it would be nice to change cache config prefix from {{general.custom.cache.<scope>.<user prop>}} to {{tserver.cache.config.<scope>.<user prop>}}. Doing this would enable setting up a cache in the shell like the following.
> {noformat}
> config -s tserver.cache.config.data.on-heap.maximumWeight=1000000000
> config -s tserver.cache.config.data.off-heap.capacity=10000000000
> config -s tserver.cache.manager.class=accumulo.ohc.OhcCacheManager
> {noformat}
> Part of the code for this prefix is at [BlockCacheManager.java line 33|https://github.com/apache/accumulo/blob/d877a2df2943e48d70d99b96616844d0dff9a501/core/src/main/java/org/apache/accumulo/core/file/blockfile/cache/BlockCacheManager.java#L33]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)