You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hbase.apache.org by "Mesika, Asaf" <as...@gmail.com> on 2013/02/08 17:36:02 UTC

Compressing data sent from HBase client

Hi,

Was the possibility of compressing RPC data sent from HBase client to Region server?
Some data pattern could benefit from this tremendously.

Another thing - As a work-around, can be this be done by using a special coprocessor which will receive the List<Put>, decompress it and then call HRegionServer to insert it? 

Thanks,

Asaf

Re: Compressing data sent from HBase client

Posted by Ted Yu <yu...@gmail.com>.

I think the following JIRA is related to what you ask:
HBASE-6966 "Compressed RPCs for HBase" (HBASE-5355) port to trunk

Before that gets integrated, you can manage compression yourself.
prePut() is given reference to the Put:

  void prePut(final ObserverContext<RegionCoprocessorEnvironment> c,

      final Put put, final WALEdit edit, final boolean writeToWAL)
where you can manipulate the contents of the Put.

Cheers

On Fri, Feb 8, 2013 at 8:36 AM, Mesika, Asaf <as...@gmail.com> wrote:

> Hi,
>
> Was the possibility of compressing RPC data sent from HBase client to
> Region server?
> Some data pattern could benefit from this tremendously.
>
> Another thing - As a work-around, can be this be done by using a special
> coprocessor which will receive the List<Put>, decompress it and then call
> HRegionServer to insert it?
>
> Thanks,
>
> Asaf
>
>