You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Ranadip (JIRA)" <ji...@apache.org> on 2013/01/08 12:18:12 UTC

[jira] [Created] (HADOOP-9188) FileUtil.CopyMerge can support optional headers and footers when merging files

Ranadip created HADOOP-9188:
-------------------------------

             Summary: FileUtil.CopyMerge can support optional headers and footers when merging files
                 Key: HADOOP-9188
                 URL: https://issues.apache.org/jira/browse/HADOOP-9188
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Ranadip


Similar to addString - which is added at the end of each merged file - there should be the option to add some rows of header strings and footer strings globally at the beginning and end of the single merged file.


Background: My experience has been that this method is mostly used to aggregate part-files into a single file that can be sent, for example, as a data feed file or a report to business customers. In such cases there is often a requirement to provide header and footer rows - with headers describing the schema of the data and the footers (or even headers in some cases) containing stats like total counts, bad record counts, etc. Along with [#HADOOP-9187], I have found myself replicating this method to add these features at least in 3 different use cases.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira