You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Kyle Purtell (Jira)" <ji...@apache.org> on 2021/06/10 19:51:00 UTC

[jira] [Created] (HBASE-25994) Active WAL tailing fails when WAL value compression is enabled

Andrew Kyle Purtell created HBASE-25994:
-------------------------------------------

             Summary: Active WAL tailing fails when WAL value compression is enabled
                 Key: HBASE-25994
                 URL: https://issues.apache.org/jira/browse/HBASE-25994
             Project: HBase
          Issue Type: Bug
    Affects Versions: 2.5.0
            Reporter: Andrew Kyle Purtell
            Assignee: Andrew Kyle Purtell
             Fix For: 3.0.0-alpha-1, 2.5.0


Depending on which compression codec is used, a short read of the compressed bytes can cause catastrophic errors that confuse the WAL reader. This problem can manifest when the reader is actively tailing the WAL for replication. The input stream's available() method sometimes lies so cannot be relied upon. To avoid these issues, when WAL value compression is enabled, ensure all bytes of the compressed value are read before submitting the payload to the decompressor. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)