You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sameer Paranjpye (JIRA)" <ji...@apache.org> on 2007/06/27 19:15:26 UTC

[jira] Updated: (HADOOP-957) Map/Reduce job with SequenceFileOutputFormat should be able to add user specified metadata to the output file

     [ https://issues.apache.org/jira/browse/HADOOP-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sameer Paranjpye updated HADOOP-957:
------------------------------------

    Component/s: mapred
    Description: 
When creating a map/reduce job with SequenceFileFormat, 
the user would like to add some metada to the output files automatically. 
In particular, if the output value class was a JuteRecord class generated from a Jute IDL, 
we would like to add JUTE_IDL/IDL_STRING as a attribute/value pair of the metadata.
This way, the output files will be self describing: 
When an application that tries to use the files may not have the value class with it. 
But the application can use Jute tool to generate the classes on demand.
Or better yet, the SequenceFile record reader may be able to do that automatically.




  was:

When creating a map/reduce job with SequenceFileFormat, 
the user would like to add some metada to the output files automatically. 
In particular, if the output value class was a JuteRecord class generated from a Jute IDL, 
we would like to add JUTE_IDL/IDL_STRING as a attribute/value pair of the metadata.
This way, the output files will be self describing: 
When an application that tries to use the files may not have the value class with it. 
But the application can use Jute tool to generate the classes on demand.
Or better yet, the SequenceFile record reader may be able to do that automatically.





> Map/Reduce job with SequenceFileOutputFormat should be able to add user specified metadata to the output file
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-957
>                 URL: https://issues.apache.org/jira/browse/HADOOP-957
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Runping Qi
>
> When creating a map/reduce job with SequenceFileFormat, 
> the user would like to add some metada to the output files automatically. 
> In particular, if the output value class was a JuteRecord class generated from a Jute IDL, 
> we would like to add JUTE_IDL/IDL_STRING as a attribute/value pair of the metadata.
> This way, the output files will be self describing: 
> When an application that tries to use the files may not have the value class with it. 
> But the application can use Jute tool to generate the classes on demand.
> Or better yet, the SequenceFile record reader may be able to do that automatically.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.