You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2016/12/08 23:43:58 UTC

[jira] [Commented] (KUDU-1524) Flushing large compressed values can cause a crash

    [ https://issues.apache.org/jira/browse/KUDU-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733744#comment-15733744 ] 

Todd Lipcon commented on KUDU-1524:
-----------------------------------

Added e1acdfba66913819f9c5d604ad5449e1eca83766 for 1.2 which at least allows this to be worked around by raising the unsafe flag 'max_cfile_block_size'

> Flushing large compressed values can cause a crash
> --------------------------------------------------
>
>                 Key: KUDU-1524
>                 URL: https://issues.apache.org/jira/browse/KUDU-1524
>             Project: Kudu
>          Issue Type: Bug
>          Components: cfile
>            Reporter: Jean-Daniel Cryans
>            Priority: Critical
>
> It's possible right now to insert values that cannot be flushed. If a column is configured to be compressed, the block compressor will limit blocks to 16MB so if a large value isn't compressible, it won't be flushable. It will show up like this in the log:
> {noformat}
> Invalid argument: Flush to disk failed: estimated max size 29545252 is greater than the expected 16777216
> {noformat}
> Once this happens it's impossible to bring the server back since it will bootstrap the tablet, try flushing again, and crash.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)