[jira] [Comment Edited] (KUDU-2725) RollingDiskRowSetWriter create rowsets that are bigger than the target rowset size

["Will Berkeley (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KUDU-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783828#comment-16783828 ] 

Will Berkeley edited comment on KUDU-2725 at 3/4/19 10:14 PM:
--------------------------------------------------------------

One can workaround this problem by increasing the compaction budget {{--tablet_compaction_budget_mb}}.


was (Author: wdberkeley):
One can workaround this problem by increasing the target rowset size {{--budgeted_compaction_target_rowset_size}}.

> RollingDiskRowSetWriter create rowsets that are bigger than the target rowset size
> ----------------------------------------------------------------------------------
>
>                 Key: KUDU-2725
>                 URL: https://issues.apache.org/jira/browse/KUDU-2725
>             Project: Kudu
>          Issue Type: Improvement
>    Affects Versions: 1.9.0
>            Reporter: Will Berkeley
>            Priority: Major
>
> The diskrowset writer create rowsets that are bigger than the target rowset size, with the excess proportional to the number of columns that compress poorly. For example, modifying loadgen to create a table with 280 columns and then using the {{--use_random}} flag, I saw rowsets that were in excess of 80MB. This is a problem because the budget for compactions is 128MB, so rowsets that are that big can never participate in a compaction.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)