You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2006/11/21 23:17:05 UTC

[jira] Commented: (HADOOP-732) SequenceFile's header should allow to store metadata in the form of key/value pairs

    [ http://issues.apache.org/jira/browse/HADOOP-732?page=comments#action_12451794 ] 
            
Owen O'Malley commented on HADOOP-732:
--------------------------------------

Would the meta-data key/value pairs be required to be strings? That would simplify everything. It isn't clear what the right API for this would be.

> SequenceFile's header should allow to store metadata in the form of key/value pairs
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-732
>                 URL: http://issues.apache.org/jira/browse/HADOOP-732
>             Project: Hadoop
>          Issue Type: New Feature
>            Reporter: Runping Qi
>
> The sequence file currently stores a fixed list of metadata attributes, such as key/value class names, 
> compression method, etc.  To make sequence file more self descriptable, it should allow to store a list of key/value pairs.  One particular attribute of interest is to indicate whether the key/value classes are actually hadoop record classes, 
> if so, store the DDls for the records. This way, we may create tools to extract DDl from a sequence file and 
> then generate necessary classes. It also make it possible to provide an interpretive version of Hadoop record. 
> This way, even in the situation where Hadoop or the application does not have the necessary classes, 
> a sequence file of Hadoop records can be read and deserialized "interpretively".

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira