[jira] [Commented] (AVRO-406) Support streaming RPC calls

["Zoltan Farkas (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AVRO-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979222#comment-14979222 ] 

Zoltan Farkas commented on AVRO-406:
------------------------------------

Its 2015 :-)  Streaming functionality is implemented in GRPC which uses http://www.grpc.io/docs/guides/wire.html underneath.

Grpc doc claims they can support any type of serialization... so maybe worth looking into integrating avro serialization into grpc?

Grpc uses HTTP/2 underneath (uses netty in the java implementation) which allows for multiplexing multiple requests on the same tcp pipe...

without streaming a rpc interface is not very useful... 



> Support streaming RPC calls
> ---------------------------
>
>                 Key: AVRO-406
>                 URL: https://issues.apache.org/jira/browse/AVRO-406
>             Project: Avro
>          Issue Type: New Feature
>          Components: java, spec
>            Reporter: Todd Lipcon
>              Labels: rpc
>
> Avro nicely supports chunking of container types into multiple frames. We need to expose this to RPC layer to facilitate use cases like the Hadoop Datanode where a single "RPC" can yield far more data than should be buffered in memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)