You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Devaraj Das (Created) (JIRA)" <ji...@apache.org> on 2012/04/03 20:38:23 UTC

[jira] [Created] (HBASE-5705) Introduce Protocol Buffer RPC engine

Introduce Protocol Buffer RPC engine
------------------------------------

                 Key: HBASE-5705
                 URL: https://issues.apache.org/jira/browse/HBASE-5705
             Project: HBase
          Issue Type: Sub-task
            Reporter: Devaraj Das


Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406557#comment-13406557 ] 

stack commented on HBASE-5705:
------------------------------

I added some comments up in RB.  Seems like pb stuff goes via Writables still?  Would be nice if I did not have to read hadoop-7773 patch to figure out what this change is doing.  Any chance of a sentence or two on intent?  Good stuff DD.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>         Attachments: 5705-1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406255#comment-13406255 ] 

Zhihong Ted Yu commented on HBASE-5705:
---------------------------------------

HBASE-6039 has removed HMasterInterface.
Please adjust patch accordingly.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>         Attachments: 5705-1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423311#comment-13423311 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

bq. The Writable wrapper goes away when we move to pb engine?

Yes (AFAICT).

bq. Its header length only right? Thats ok I'd say. But for the value, when its a 50M cell, we won't have to read it into a buffer to find its size before sending will we when we are pb? (pb does this internally probably but we do we have to do it again outside of pb to put it in rpc header?)

No we don't have to write to a buffer in the case of PB objects. There is a getSerializedSize method on PB objects (and assuming that the 50M cell is encapsulated in the PB object as a byte-array, PB would simply call byte-array.length...).


                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422971#comment-13422971 ] 

stack commented on HBASE-5705:
------------------------------

All of above seems reasonable.  Here is some response.

bq. ...Could you please point me to the block of code in the patch where this is.

I do not see it now.

bq. ...and in the case of ProtobufRpcEngine, they are done using RpcRequestWritable (a thin wrapper over PB objects).

The Writable wrapper goes away when we move to pb engine?

bq. ...In that sense, we need the message size.

Its header length only right?   Thats ok I'd say.  But for the value, when its a 50M cell, we won't have to read it into a buffer to find its size before sending will we when we are pb?  (pb does this internally probably but we do we have to do it again outside of pb to put it in rpc header?)


                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422623#comment-13422623 ] 

stack commented on HBASE-5705:
------------------------------

np I responded up on rb.  See my other comments above (ignore stuff that is duplicated and already answered).  Any useful stuff in above feedback?  If so, address and lets get this in.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424654#comment-13424654 ] 

Hadoop QA commented on HBASE-5705:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12538291/5705-2.3.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 17 new or modified tests.

    +1 hadoop2.0.  The patch compiles against the hadoop 2.0 profile.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).

    -1 findbugs.  The patch appears to introduce 6 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

     -1 core tests.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.replication.TestMasterReplication

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2452//console

This message is automatically generated.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch, 5705-2.3.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424849#comment-13424849 ] 

Hudson commented on HBASE-5705:
-------------------------------

Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #115 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/115/])
    HBASE-5705 Introduce Protocol Buffer RPC engine (Revision 1367009)

     Result = FAILURE
stack : 
Files : 
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/ClientCache.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/HBaseClient.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/HBaseRPC.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/HBaseServer.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/Invocation.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/ProtobufRpcEngine.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/WritableRpcEngine.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/MonitoredRPCHandlerImpl.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/generated/RPCProtos.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* /hbase/trunk/hbase-server/src/main/protobuf/RPC.proto
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestProtoBufRpc.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf/generated
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf/generated/TestProtos.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf/generated/TestRpcServiceProtos.java
* /hbase/trunk/hbase-server/src/test/protobuf
* /hbase/trunk/hbase-server/src/test/protobuf/test.proto
* /hbase/trunk/hbase-server/src/test/protobuf/test_rpc_service.proto

                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch, 5705-2.3.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HBASE-5705:
-------------------------------

    Attachment: 5705-2.2.patch

bq. I asked about comment in ClientCache in previous reviews but it went unanswered. I'm talking about the old Doug comment on a. vs. b. choice. I didn't understand it then and less so now. Is it a copy/paste error?

Answered on RB but a little bit more here - I think it makes sense to remove this confusing comment (since now the ClientCache class has some javadoc). I'll remove it in the next patch.

bq. The writing to a buffer before we write on the line goes away if we move to a pure pb engine?

Right.

bq. Is the size used here right for case where we have an exception? (Or its just a hint?)

Hint.

bq. And RPCRequestWritable and RPCResponseWritable will go away too when we do pb? (You've answered yes to this multiple times I believe).

Yes (AFAICT).

bq. Why the need for a setRPC w/ no params?

Could you please point me to the block of code in the patch where this is.. If you are referring to the setRPC with two params that I added here, that I reverted back in my current update.. (and added a comment up on HBASE-6282).

bq. This stuff passed to Server, whats it about? Is this some Hadoop thing about being able to do multiple serializations?

This is to handle WritableRpcEngine and ProtobufRpcEngine equally well. In the case of WritableRpcEngine, the RPC request is serialized using Invocation objects and in the case of ProtobufRpcEngine, they are done using RpcRequestWritable (a thin wrapper over PB objects).

bq. When we do logResponse, we no longer take a Call but we pass in its name and methodnames and params.... is that a regression? Would it be better to take the Invocation?

This is handled in the way that the method now takes methodname and params explicitly (as opposed to how it is in the current trunk where an Invocation object is passed and the method body extracts the params and methodname). This was needed to support ProtobufRpc. Also, HBASE-6282 is applicable here.

bq. In header can we say if its pbs that follow? Or will we have to always calc message size before sending?
The RPC requires that any RPC message is preceded by the length of the same. In that sense, we need the message size.

bq. Why we need this: clientProtocolVersion in request? Is this Writables thing? It goes away when we go pb?
The clientProtocolVersion is currently unused on the server side (and it's optional in the .proto definition), but it could potentially be used in the server to decide how to best service the client's RPC (if there were multiple implementations for a method, and the server could pick an implementation based on client version). If this use case seems like we probably won't need to support, we can drop the clientProtocolVersion (btw it being optional in the .proto definition makes it amenable to easy removal even later). By keeping it, it doesn't hurt either..
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405414#comment-13405414 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

https://reviews.apache.org/r/5714/ is the RB page with the patch..
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>         Attachments: 5705-1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422356#comment-13422356 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

Sorry, seems like I forgot to "publish" my responses to the comments on RB on some occasions. I "published" all of them now. Apologize for the out-of-order responses. I'll respond to your comments shortly, Stack (thanks for looking).
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhihong Ted Yu updated HBASE-5705:
----------------------------------

    Attachment: 5705-2.1.patch

Patch from Devaraj.
I verified that it compiles against latest trunk.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HBASE-5705:
-------------------------------

    Attachment: 5705-1.patch

Early patch that at least builds. Still working on it. 
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>         Attachments: 5705-1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422838#comment-13422838 ] 

Hadoop QA commented on HBASE-5705:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12537940/5705-2.2.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 17 new or modified tests.

    +1 hadoop2.0.  The patch compiles against the hadoop 2.0 profile.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).

    -1 findbugs.  The patch appears to introduce 15 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2438//console

This message is automatically generated.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhihong Ted Yu updated HBASE-5705:
----------------------------------

    Fix Version/s: 0.96.0
           Status: Patch Available  (was: Open)
    
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424015#comment-13424015 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

Thanks for the reviews, Stack & Ted.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406330#comment-13406330 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

Thanks for looking at the patch, Ted. I'll update it soon.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>         Attachments: 5705-1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das reassigned HBASE-5705:
----------------------------------

    Assignee: Devaraj Das
    
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422313#comment-13422313 ] 

stack commented on HBASE-5705:
------------------------------

I'd vote for removing Writables engine once all pb converted.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422338#comment-13422338 ] 

stack commented on HBASE-5705:
------------------------------

RB is not working for me at mo so reviews here:

I asked about comment in ClientCache in previous reviews but it went unanswered.  I'm talking about the old Doug comment on a. vs. b. choice.  I didn't understand it then and less so now.  Is it a copy/paste error?

The writing to a buffer before we write on the line goes away if we move to a pure pb engine?

Is the size used here right for case where we have an exception? (Or its just a hint?)

     ByteBufferOutputStream buf = new ByteBufferOutputStream(size);

And RPCRequestWritable and RPCResponseWritable will go away too when we do pb? (You've answered yes to this multiple times I believe).

Why the need for a setRPC w/ no params?

This stuff passed to Server, whats it about?  Is this some Hadoop thing about being able to do multiple serializations?

                  Class<? extends Writable> paramClass,

When we do logResponse, we no longer take a Call but we pass in its name and methodnames and params.... is that a regression?  Would it be better to take the Invocation?


The below doesn't look too bad:

<"hrpc"-bytearray><'5'-byte><length-of-serialized-ConnectionHeader-obj[int32]><ConnectionHeader-object serialized>

In header can we say if its pbs that follow?  Or will we have to always calc message size before sending?

Why we need this: clientProtocolVersion  in request?  Is this Writables thing?  It goes away when we go pb?


My general thought on this is we commit.  This patch has same shape as our current rpc'ing; same classes, etc. just moved over some to support pb.  We need to go pure pb and get rid of Writables in this rpc call path.  I see this as a stepping stone so we should get it in so we can undo it later w/ pb engine.


                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424738#comment-13424738 ] 

Hudson commented on HBASE-5705:
-------------------------------

Integrated in HBase-TRUNK #3183 (See [https://builds.apache.org/job/HBase-TRUNK/3183/])
    HBASE-5705 Introduce Protocol Buffer RPC engine (Revision 1367009)

     Result = FAILURE
stack : 
Files : 
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/ClientCache.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/HBaseClient.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/HBaseRPC.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/HBaseServer.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/Invocation.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/ProtobufRpcEngine.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/WritableRpcEngine.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/MonitoredRPCHandlerImpl.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/generated/RPCProtos.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* /hbase/trunk/hbase-server/src/main/protobuf/RPC.proto
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestProtoBufRpc.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf/generated
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf/generated/TestProtos.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/protobuf/generated/TestRpcServiceProtos.java
* /hbase/trunk/hbase-server/src/test/protobuf
* /hbase/trunk/hbase-server/src/test/protobuf/test.proto
* /hbase/trunk/hbase-server/src/test/protobuf/test_rpc_service.proto

                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch, 5705-2.3.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13409983#comment-13409983 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

I updated RB with the new patch. Yes, the PB stuff goes via writables still. Some of the stuff can be put within a if/else logic for PB vs. Writable but when I did it, it seemed to make the code complex. So am thinking of doing the work of making RPC use as much of PB as possible as a follow up (and at that time, remove the WritableRpcEngine/Invocation classes), when all the application protocols are converted to PB. Open to feedback on this aspect. 
Once the above is done, the use of PB RPC Engine should make things more efficient in terms of avoiding copies in the rpc layer (for example in the RPC layer, if we needed to write a pair of {message-length, message}, in the current RPC, we would need to serialize the Writable object into a buffer, and then get the length of the buffer. In the PB world, every message has a getSerializedSize method generated..)
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422818#comment-13422818 ] 

Devaraj Das commented on HBASE-5705:
------------------------------------

bq. My general thought on this is we commit. This patch has same shape as our current rpc'ing; same classes, etc. just moved over some to support pb. We need to go pure pb and get rid of Writables in this rpc call path. I see this as a stepping stone so we should get it in so we can undo it later w/ pb engine.

+1
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13410283#comment-13410283 ] 

Hadoop QA commented on HBASE-5705:
----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12535753/5705-2.1.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 17 new or modified tests.

    +1 hadoop2.0.  The patch compiles against the hadoop 2.0 profile.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).

    -1 findbugs.  The patch appears to introduce 9 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

     -1 core tests.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2356//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2356//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2356//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2356//console

This message is automatically generated.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated HBASE-5705:
-------------------------------

    Attachment: 5705-2.3.patch

Noticed that the patch went stale. Updated. (Can this please be committed.)
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch, 5705-2.3.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423331#comment-13423331 ] 

stack commented on HBASE-5705:
------------------------------

I'm going to commit this in next day unless objection.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HBASE-5705) Introduce Protocol Buffer RPC engine

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-5705:
-------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Committed to trunk.  Thanks Deveraj.
                
> Introduce Protocol Buffer RPC engine
> ------------------------------------
>
>                 Key: HBASE-5705
>                 URL: https://issues.apache.org/jira/browse/HBASE-5705
>             Project: HBase
>          Issue Type: Sub-task
>          Components: ipc, master, migration, regionserver
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.96.0
>
>         Attachments: 5705-1.patch, 5705-2.1.patch, 5705-2.2.patch, 5705-2.3.patch
>
>
> Introduce Protocol Buffer RPC engine in the RPC core. Protocols that are PB aware can be made to go through this RPC engine. The approach, in my current thinking, would be similar to HADOOP-7773.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira