You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Haohui Mai (JIRA)" <ji...@apache.org> on 2015/03/05 03:29:38 UTC

[jira] [Moved] (HADOOP-11671) Asynchronous native RPC v9 client

     [ https://issues.apache.org/jira/browse/HADOOP-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Haohui Mai moved HDFS-7887 to HADOOP-11671:
-------------------------------------------

        Key: HADOOP-11671  (was: HDFS-7887)
    Project: Hadoop Common  (was: Hadoop HDFS)

> Asynchronous native RPC v9 client
> ---------------------------------
>
>                 Key: HADOOP-11671
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11671
>             Project: Hadoop Common
>          Issue Type: New Feature
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>
> There are more and more integration happening between Hadoop and applications that are implemented using languages other than Java.
> To access Hadoop, applications either have to go through JNI (e.g. libhdfs), or to reverse engineer the Hadoop RPC protocol. (e.g. snakebite). Unfortunately, neither of them are satisfactory:
> * Integrating with JNI requires running a JVM inside the application. Some applications (e.g., real-time processing, MPP database) does not want the footprints and GC behavior of the JVM.
> * The Hadoop RPC protocol has a rich feature set including wire encryption, SASL, Kerberos authentication. Many 3rd-party implementations can fully cover the feature sets thus they might work in limited environment.
> This jira is to propose implementing an Hadoop RPC library in C++ that provides a common ground to implement higher-level native client for HDFS, YARN, and MapReduce.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)