You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2013/07/02 00:09:20 UTC
[jira] [Updated] (HBASE-8737) [replication] Change replication RPC
to use cell blocks
[ https://issues.apache.org/jira/browse/HBASE-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-8737:
-------------------------
Attachment: 8737v5.txt
Address Chris and Jesse feedback from rb.
Added a main to TestIPCUtil which allows passing counts and cell sizes. Used it to do some compare of fixed buffer size vs estimating buffer size by iterating Cells. As expected, if we exceed fixed buffer size, the estimation makes for big savings (saw half the time to complete cycling 1k times w/ 10k cells) but if the cell block is <= fixed cell block size, the estimation costs.
For now, if a SizedCellScanner, use the size otherwise, just go w/ the fixed size buffer.
> [replication] Change replication RPC to use cell blocks
> -------------------------------------------------------
>
> Key: HBASE-8737
> URL: https://issues.apache.org/jira/browse/HBASE-8737
> Project: HBase
> Issue Type: Improvement
> Components: Replication
> Reporter: Chris Trezzo
> Assignee: stack
> Priority: Critical
> Fix For: 0.98.0, 0.95.2
>
> Attachments: 0001-HBASE-8737-replication-Change-replication-RPC-to-use.patch, 8737.txt, 8737v3.txt, 8737v4.txt, 8737v5.txt
>
>
> Currently, the replication rpc that ships edits simply dumps the byte value of WAL edit key/value pairs into a protobuf message.
> Modify the replication rpc mechanism to use cell blocks so it can leverage encoding and compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira