[jira] Updated: (HADOOP-65) add a record I/O framework to hadoop

["Milind Bhandarkar (JIRA)" <ji...@apache.org>]

     [ http://issues.apache.org/jira/browse/HADOOP-65?page=all ]

Milind Bhandarkar updated HADOOP-65:
------------------------------------

    Attachment: HadoopRecordIO.patch

I have attached a patch for Hadoop record I/O framework. It contains a translator for generating Java or C++ code from the record definitions, and a Java and C++ runtime library for serializing and deserializing records in binary, CSV, and XML formats. Generated Java code for records implements the WritableComparable interface, so these records could be used as keys and values for the Hadooop map-reduce framework. See the package.html file in org.apache.hadoop.record for full description.

> add a record I/O framework to hadoop
> ------------------------------------
>
>          Key: HADOOP-65
>          URL: http://issues.apache.org/jira/browse/HADOOP-65
>      Project: Hadoop
>         Type: New Feature

>   Components: io, ipc
>     Versions: 0.2
>     Reporter: Sameer Paranjpye
>     Priority: Minor
>      Fix For: 0.2
>  Attachments: HadoopRecordIO.patch
>
> Hadoop could benefit greatly from a simple record I/O framework that enables the specification of simple record types and enables the generation of code for serialization/deserialization in multiple target languages. The framework would handle a small well understood set of primitive types and simple compositions of these (structs, vectors, maps) . It would be possible to leverage this framework to express I/O in MapReduce computations and to use this as the basis for Hadoops RPC implementation. This would make interfacing with code in languages other than Java much easier.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira