You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2006/05/04 06:12:18 UTC

[jira] Commented: (HADOOP-65) add a record I/O framework to hadoop

    [ http://issues.apache.org/jira/browse/HADOOP-65?page=comments#action_12377702 ] 

Doug Cutting commented on HADOOP-65:
------------------------------------

Looking a bit more closely, I see that some of the packages and classes are missing javadoc.  Can you please supply an additional patch which adds this?  In many cases, javadoc comments are only needed on base classes and interfaces (e.g., JType, InputArchive, OutputArchive) as they will automatically propagate to subclasses & implementations.  Also, the JavaCC-generated code will in many places lack javadoc, but a package.html explaining that the package contains only generated code would be useful.

> add a record I/O framework to hadoop
> ------------------------------------
>
>          Key: HADOOP-65
>          URL: http://issues.apache.org/jira/browse/HADOOP-65
>      Project: Hadoop
>         Type: New Feature

>   Components: io, ipc
>     Versions: 0.2
>     Reporter: Sameer Paranjpye
>     Priority: Minor
>      Fix For: 0.2
>  Attachments: HadoopRecordIO.patch
>
> Hadoop could benefit greatly from a simple record I/O framework that enables the specification of simple record types and enables the generation of code for serialization/deserialization in multiple target languages. The framework would handle a small well understood set of primitive types and simple compositions of these (structs, vectors, maps) . It would be possible to leverage this framework to express I/O in MapReduce computations and to use this as the basis for Hadoops RPC implementation. This would make interfacing with code in languages other than Java much easier.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira