[jira] [Created] (SPARK-1729) Make Flume pull data from source, rather than the current push model

["Tathagata Das (JIRA)" <ji...@apache.org>]

Tathagata Das created SPARK-1729:
------------------------------------

             Summary: Make Flume pull data from source, rather than the current push model
                 Key: SPARK-1729
                 URL: https://issues.apache.org/jira/browse/SPARK-1729
             Project: Spark
          Issue Type: Sub-task
          Components: Streaming
    Affects Versions: 1.0.0
            Reporter: Tathagata Das
            Assignee: Hari Shreedharan


This makes sure that the if the Spark executor running the receiver goes down, the new receiver on a new node can still get data from Flume.

This is not possible in the current model, as Flume is configured to push data to a executor/worker and if that worker is down, Flume cant push data.



--
This message was sent by Atlassian JIRA
(v6.2#6252)