[GitHub] merlimat commented on issue #1582: Introduce pulsar replicator

[GitBox <gi...@apache.org>]

merlimat commented on issue #1582: Introduce pulsar replicator 
URL: https://github.com/apache/incubator-pulsar/issues/1582#issuecomment-393408727
 
 
   @cricket007 The naming here was indeed a bit misleading since this is more around integrating heterogeneous systems with Pulsar.
   
   Pulsar has always had "replicator" functionalities, in a much more advanced form compared to MirrorMaker or other proprietary solutions (http://pulsar.apache.org/docs/latest/admin/GeoReplication/). 
   
   Geo-replication targets at replication between Pulsar clusters. Because on both sides we have Pulsar brokers that talk native Pulsar protocol, we can achieve a lot of efficiencies.
   
   Regarding the changes for this PR, the consensus has been to focus the efforts on a single "connector" framework, named "Pulsar-IO" which is scheduled for 2.1 release. 
   
   The work on Pulsar-IO framework address the problem of getting data in & out of Pulsar in the simplest possible way from a user standpoint: 
    * No need to write code, just specify the configuration for sources and sinks
    * No need to "run" the connector, the system takes care of managing the connectors runtime
   
   If you're interested, you can checkout the work in progress: https://github.com/apache/incubator-pulsar/tree/master/pulsar-io . There's also a PR with some in-progress documentation: https://github.com/apache/incubator-pulsar/pull/1749
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services