You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Ranadip (JIRA)" <ji...@apache.org> on 2013/01/08 12:18:12 UTC
[jira] [Created] (HADOOP-9188) FileUtil.CopyMerge can support
optional headers and footers when merging files
Ranadip created HADOOP-9188:
-------------------------------
Summary: FileUtil.CopyMerge can support optional headers and footers when merging files
Key: HADOOP-9188
URL: https://issues.apache.org/jira/browse/HADOOP-9188
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ranadip
Similar to addString - which is added at the end of each merged file - there should be the option to add some rows of header strings and footer strings globally at the beginning and end of the single merged file.
Background: My experience has been that this method is mostly used to aggregate part-files into a single file that can be sent, for example, as a data feed file or a report to business customers. In such cases there is often a requirement to provide header and footer rows - with headers describing the schema of the data and the footers (or even headers in some cases) containing stats like total counts, bad record counts, etc. Along with [#HADOOP-9187], I have found myself replicating this method to add these features at least in 3 different use cases.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira