You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Mike Percy (JIRA)" <ji...@apache.org> on 2012/11/13 20:50:14 UTC

[jira] [Created] (FLUME-1704) HDFS sink: Add option to prefix .tmp files with some string like "_" or "."

Mike Percy created FLUME-1704:
---------------------------------

             Summary: HDFS sink: Add option to prefix .tmp files with some string like "_" or "."
                 Key: FLUME-1704
                 URL: https://issues.apache.org/jira/browse/FLUME-1704
             Project: Flume
          Issue Type: Improvement
            Reporter: Mike Percy
             Fix For: v1.4.0


We should add the capability to the HDFS sink to specify a prefix for the .tmp files. I believe this needs to be configurable and disabled by default.

However we should document that we recommend "_" or "." as a prefix for the temp files.

This is because Hadoop's default FileInputFormat will skip files beginning with "_" or "."

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (FLUME-1704) HDFS sink: Add option to prefix .tmp files with some string like "_" or "."

Posted by "Brock Noland (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brock Noland resolved FLUME-1704.
---------------------------------

    Resolution: Duplicate

Duplicates FLUME-1702
                
> HDFS sink: Add option to prefix .tmp files with some string like "_" or "."
> ---------------------------------------------------------------------------
>
>                 Key: FLUME-1704
>                 URL: https://issues.apache.org/jira/browse/FLUME-1704
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Mike Percy
>             Fix For: v1.4.0
>
>
> We should add the capability to the HDFS sink to specify a prefix for the .tmp files. I believe this needs to be configurable and disabled by default.
> However we should document that we recommend "_" or "." as a prefix for the temp files.
> This is because Hadoop's default FileInputFormat will skip files beginning with "_" or "."

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira