You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/04/08 09:01:34 UTC
[GitHub] [pulsar] kitekite2020 opened a new issue #6693: We would like to
have pulsar clusters in two data centers. They active and active. And we
would like to replicate messages from one site and the other. i.e. the
subscriber from each site will receive messages from publishers at two
sites. And no message loss.
kitekite2020 opened a new issue #6693: We would like to have pulsar clusters in two data centers. They active and active. And we would like to replicate messages from one site and the other. i.e. the subscriber from each site will receive messages from publishers at two sites. And no message loss.
URL: https://github.com/apache/pulsar/issues/6693
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
**Describe the solution you'd like**
A clear and concise description of what you want to happen.
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
Add any other context or screenshots about the feature request here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] kitekite2020 commented on issue #6693: We would like to
have pulsar clusters in two data centers. They active and active. And we
would like to replicate messages from one site and the other. i.e. the
subscriber from each site will receive messages from publishers at two
sites. And no message loss.
Posted by GitBox <gi...@apache.org>.
kitekite2020 commented on issue #6693: We would like to have pulsar clusters in two data centers. They active and active. And we would like to replicate messages from one site and the other. i.e. the subscriber from each site will receive messages from publishers at two sites. And no message loss.
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-610844869
We would like to have pulsar clusters in two data centers. They are active and active. And we would like to replicate messages from one site to the other. i.e. the subscriber from one site will receive messages from publishers at two sites. And no message loss. If one site is down, the other site can continue to work.
We are thinking of geo replication. But since geo replication is asynchronous, we are worried about message loss. Every single message cannot be lost.
Then we are thinking to have synchronous replication, at bookkeeper level, cross two sites. First difficulty is there is no examples of how to do it without global zookeeper. If we use two clusters to manage each site, we need a global configuration store to manage two sites information which becomes a single point failure. If we use global zookeeper, one zookeeper for two sites, due to zookeeper cluster has to be 2*n+1 nodes, it means if the site with n+1 node fails, the other site also stops working.
Is my understanding right? Is there a possible solution with Pulsar for us? Thanks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] codelipenghui edited a comment on issue #6693:
Active-active and no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
codelipenghui edited a comment on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-610852992
> We are thinking of geo replication. But since geo replication is asynchronous, we are worried about message loss. Every single message cannot be lost.
The geo-replication is asynchronous, but it does not result in message loss. The replication state is stored in a cursor(ledger backend), even the broker crash, the replication state not lost. So the new broker can resume the replicate task.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] kitekite2020 commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
kitekite2020 commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-612708075
Would like to clarify for geo-replication message delivery. Is it more like TCP, every message got acknowledged when it is replicated successfully to the other site, or more like UDP, fire and forget?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-610981517
Yes, it is stored in bookies(data is replicated in the certain bookies). So you can increase the data replicas to avoid data loss.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-610852992
> We are thinking of geo replication. But since geo replication is asynchronous, we are worried about message loss. Every single message cannot be lost.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-611326991
Yes, the metrics related to the replication is described at https://pulsar.apache.org/docs/en/reference-metrics/#replication-metrics-1, and https://github.com/streamnative/apache-pulsar-grafana-dashboard already contains message replication related dashboards. You can checkout and try it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] kitekite2020 commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
kitekite2020 commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-610859297
> Is the message replication guaranteed?
The replication state is stored in a cursor(ledger backend) -> Does this mean it is stored in bookie? What if this bookie crashes?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] kitekite2020 commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
kitekite2020 commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-611278158
> Yes, it is stored in bookies(data is replicated in the certain bookies). So you can increase the data replicas to avoid data loss.
Thank you. So I understand from you that there is a mechanism to trace or manage which message is replicated and make sure all messages are replicated. That is great.
Is there a mechanism to trace which is message replicated and received by the target cluster/site?
I am also trying if possible to use grafana and prometheus to validate if there is message loss. Any advice here?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] kitekite2020 commented on issue #6693: Active-active and
no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
kitekite2020 commented on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-612707654
> Yes, the metrics related to the replication is described at https://pulsar.apache.org/docs/en/reference-metrics/#replication-metrics-1, and https://github.com/streamnative/apache-pulsar-grafana-dashboard already contains message replication related dashboards. You can checkout and try it.
Thanks. Was trying this dashboard. Had some problems and will figure out why.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [pulsar] kitekite2020 edited a comment on issue #6693:
Active-active and no data loss. Is it possible?
Posted by GitBox <gi...@apache.org>.
kitekite2020 edited a comment on issue #6693: Active-active and no data loss. Is it possible?
URL: https://github.com/apache/pulsar/issues/6693#issuecomment-610844869
We would like to have pulsar clusters in two data centers. They are active and active. And we would like to replicate messages from one site to the other. i.e. the subscriber from one site will receive messages from publishers at two sites. And no message loss. If one site is down, the other site can continue to work.
We are thinking of geo replication. But since geo replication is asynchronous, we are worried about message loss. Every single message cannot be lost.
Then we are thinking to have synchronous replication, at bookkeeper level, cross two sites. First difficulty is there is no examples of how to do it without global zookeeper. If we use local clusters to manage each site, we need a global configuration store to manage two sites information which becomes a single point failure. If we use global zookeeper, one zookeeper for two sites, due to zookeeper cluster has to be 2*n+1 nodes, it means if the site with n+1 node fails, the other site also stops working.
Is my understanding right? Is there a possible solution with Pulsar for us? Thanks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services