You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Arun Gujjar (JIRA)" <ji...@apache.org> on 2014/11/05 21:22:34 UTC

[jira] [Created] (FLUME-2539) Append HDFS files from multiple FLUME instances

Arun Gujjar created FLUME-2539:
----------------------------------

             Summary: Append HDFS files from multiple FLUME instances
                 Key: FLUME-2539
                 URL: https://issues.apache.org/jira/browse/FLUME-2539
             Project: Flume
          Issue Type: New Feature
          Components: Sinks+Sources
    Affects Versions: v1.4.0
         Environment: apache-flume-1.4.0-cdh4.5.0, zookeeper-3.4.5-cdh4.5.0
            Reporter: Arun Gujjar


I have multiple flume instances running in one of the test environment. Each instance creates its own FlumeData file. We have a file rotation policy set as 1 hour. So, every hour 1 file get's created. As we have 2 instances, so every hour there are two files created. Could you please tell me if there is any way I can append both instances point to 1 files. 

Basically I need just 1 file created every once in an hour and both the instance should write the data into same file. 

Please suggest how I can setup this configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)