You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2017/01/17 20:38:26 UTC

[jira] [Created] (KUDU-1835) Support compression of the WAL

Todd Lipcon created KUDU-1835:
---------------------------------

             Summary: Support compression of the WAL
                 Key: KUDU-1835
                 URL: https://issues.apache.org/jira/browse/KUDU-1835
             Project: Kudu
          Issue Type: Improvement
          Components: log, perf
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon


In some workloads, particularly those which get good compression rates of the underlying data (eg via dictionary coding), the WAL becomes a big bottleneck for write performance. In addition, the large size of WALs can often mean that old WALs get GCed rapidly and cause lagging replicas to get evicted after only a temporary bout of slowness. Making WALs smaller would mean that we can retain more history without the cost of disk space.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)