You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Eran Kutner <er...@gigya.com> on 2012/08/30 19:53:57 UTC

HDFS sink filenames

Hi,
As have been noted in several JIRAs (like
https://issues.apache.org/jira/browse/FLUME-965) in order to process AVRO
data files the file name must end with ".avro", however this seems
impossible to achieve because flume always appends the time stamp at the
end of the filename. Is there any way to work around this and prevent flume
from appending that timestamp? Why is it that behavior anyway? I would
expect flume to append a unique identifier to the file name only if it was
conflicting with an existing name, which should not happen if the file name
is carefully constructed to avoid that.


-eran