You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Adar Dembo (JIRA)" <ji...@apache.org> on 2017/04/13 02:43:41 UTC
[jira] [Updated] (KUDU-1971) Explore reducing number of data blocks
by tuning existing parameters
[ https://issues.apache.org/jira/browse/KUDU-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Adar Dembo updated KUDU-1971:
-----------------------------
Labels: data-scalability (was: )
> Explore reducing number of data blocks by tuning existing parameters
> --------------------------------------------------------------------
>
> Key: KUDU-1971
> URL: https://issues.apache.org/jira/browse/KUDU-1971
> Project: Kudu
> Issue Type: Sub-task
> Components: tablet
> Affects Versions: 1.4.0
> Reporter: Adar Dembo
> Labels: data-scalability
>
> One way to scale to larger on-disk data sets is to reduce the ratio between data blocks and data; that is, to make data blocks larger. Two existing parameters control for this:
> * budgeted_compaction_target_rowset_size: within a given flush or compaction operation, stipulates the size of each rowset. Currently 32M.
> * tablet_compaction_budget_mb: stipulates the amount of data that should be included in any given compaction. Currently 128M.
> It might be interesting to explore raising these.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)