You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Mike Percy (JIRA)" <ji...@apache.org> on 2012/11/13 20:50:14 UTC
[jira] [Created] (FLUME-1704) HDFS sink: Add option to prefix .tmp
files with some string like "_" or "."
Mike Percy created FLUME-1704:
---------------------------------
Summary: HDFS sink: Add option to prefix .tmp files with some string like "_" or "."
Key: FLUME-1704
URL: https://issues.apache.org/jira/browse/FLUME-1704
Project: Flume
Issue Type: Improvement
Reporter: Mike Percy
Fix For: v1.4.0
We should add the capability to the HDFS sink to specify a prefix for the .tmp files. I believe this needs to be configurable and disabled by default.
However we should document that we recommend "_" or "." as a prefix for the temp files.
This is because Hadoop's default FileInputFormat will skip files beginning with "_" or "."
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (FLUME-1704) HDFS sink: Add option to prefix .tmp
files with some string like "_" or "."
Posted by "Brock Noland (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland resolved FLUME-1704.
---------------------------------
Resolution: Duplicate
Duplicates FLUME-1702
> HDFS sink: Add option to prefix .tmp files with some string like "_" or "."
> ---------------------------------------------------------------------------
>
> Key: FLUME-1704
> URL: https://issues.apache.org/jira/browse/FLUME-1704
> Project: Flume
> Issue Type: Improvement
> Reporter: Mike Percy
> Fix For: v1.4.0
>
>
> We should add the capability to the HDFS sink to specify a prefix for the .tmp files. I believe this needs to be configurable and disabled by default.
> However we should document that we recommend "_" or "." as a prefix for the temp files.
> This is because Hadoop's default FileInputFormat will skip files beginning with "_" or "."
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira