You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Arun Gujjar (JIRA)" <ji...@apache.org> on 2014/11/05 21:22:34 UTC
[jira] [Created] (FLUME-2539) Append HDFS files from multiple FLUME
instances
Arun Gujjar created FLUME-2539:
----------------------------------
Summary: Append HDFS files from multiple FLUME instances
Key: FLUME-2539
URL: https://issues.apache.org/jira/browse/FLUME-2539
Project: Flume
Issue Type: New Feature
Components: Sinks+Sources
Affects Versions: v1.4.0
Environment: apache-flume-1.4.0-cdh4.5.0, zookeeper-3.4.5-cdh4.5.0
Reporter: Arun Gujjar
I have multiple flume instances running in one of the test environment. Each instance creates its own FlumeData file. We have a file rotation policy set as 1 hour. So, every hour 1 file get's created. As we have 2 instances, so every hour there are two files created. Could you please tell me if there is any way I can append both instances point to 1 files.
Basically I need just 1 file created every once in an hour and both the instance should write the data into same file.
Please suggest how I can setup this configuration.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)