[GitHub] [pulsar] liketic opened a new issue #4370: Implement Flume Source with Event driven source instead

[GitBox <gi...@apache.org>]

liketic opened a new issue #4370: Implement Flume Source with Event driven source instead 
URL: https://github.com/apache/pulsar/issues/4370
 
 
   Currently, we implemented a Flume source which is also a Pulsar connector, the base class ```SourceOfFlume``` extends Flume's ```AbstractPollableSource```, which will be called in a poll interval by an external driver. In this way, the results consumed from Pulsar will be stored in a queue as the consuming logic maybe independent absolutely. 
   
   In the other hand, Flume also support Event Driven source mode. Which will not be polled by other driver. The benefits for us, is we don't need the buffer queue any more. And for any records we got from Pulsar, we can push it to Flume channel immediately. 
   
   See https://flume.apache.org/releases/content/1.9.0/apidocs/org/apache/flume/EventDrivenSource.html for more details. 
   
   Happy to know yours thoughts.
    

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services