You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2016/04/13 01:07:25 UTC

[jira] [Updated] (HBASE-15638) Shade protobuf

     [ https://issues.apache.org/jira/browse/HBASE-15638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-15638:
--------------------------
    Attachment: as.far.as.server.patch

I got as far as server module. Stuck on how to pass a ByteString to HDFS in FanOutOneBlockAsyncDFSOutputSaslHelper and then the test of ipc which builds its own classes from protos...  Need to fix work on these.

> Shade protobuf
> --------------
>
>                 Key: HBASE-15638
>                 URL: https://issues.apache.org/jira/browse/HBASE-15638
>             Project: HBase
>          Issue Type: Bug
>          Components: Protobufs
>            Reporter: stack
>         Attachments: as.far.as.server.patch
>
>
> Shade protobufs so we can move to a different version without breaking the world. We want to get up on pb3 because it has unsafe methods that allow us save on copies; it also has some means of dealing with BBs so we can pass it offheap DBBs. We'll probably want to change PB3 to open it up some more too so we can stay offheap as we traverse PB. This issue comes of [~anoop.hbase] and [~ram_krish]'s offheaping of the readpath work.
> This change is mostly straight-forward but there are some tricky bits:
>  # How to interface with HDFS? It wants its ByteStrings. Here in particular in FanOutOneBlockAsyncDFSOutputSaslHelper:
> {code}
>       if (payload != null) {
>         builder.setPayload(ByteString.copyFrom(payload));
>       }
> {code}
>  # [~busbey] also points out that we need to take care of endpoints done as pb. Test at least.
> Let me raise this one on the dev list too.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)