You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@activemq.apache.org by GitBox <gi...@apache.org> on 2022/04/04 21:22:01 UTC
[GitHub] [activemq-artemis] iliya-gr opened a new pull request, #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
iliya-gr opened a new pull request, #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012
In cluster configuration messages could be routed to internal queues for
further delivering on different broker. We need to check that before
sending to SNF, otherwise message can stuck on target server and will
never receive ACK.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1105835069
@iliya-gr are you creating a mirror between two nodes of the same cluster? or that was just for this test?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1092874188
@iliya-gr I will handle this in detail next week.. It got my attention..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106887413
I will resume this on Monday with a fresh mind...
I plan to finish this before we release 2.22
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106759764
@iliya-gr I will have to think some more about this.. as we should not route messages to internal queues on the target as well.
I think we should also add a note discouraging clustering message distribution with mirror though.
I will have to think over the weekend... I"m pretty sure the target should route without any internal queues.. otherwise the acks will not send them back to the mirror where they came from.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106879790
@iliya-gr say you are sending to a destination with strict load balancing... the server on other side of the mirror will then send to its cluster.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1107519908
Great, thanks for helping me with this!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106880536
regarding scope/filter.. I thought about adding a filter clause on the mirror. The reason I did not do it was I would need to figure out an efficient way to filter it.. so I postponed it... but if we find a optimal way to filter the addresses we could do it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1105817825
ahhhh... I see... if a single queue is routable, this would return false.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106791046
@clebertsuconic I thought it's not possible. Target may send message to internal queue only if it was originally send to internal queue. Maybe just as a precaution of possible acks errors. But maybe I have overlooked something, will check that.
> I think we should also add a note discouraging clustering message distribution with mirror though.
I'm not sure I got you right. I think there is nothing wrong in mirror + cluster. I think what is missing is mirror scope/filter parameter that will allow mirroring only specific queues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1091473831
I have added integration test for this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106915511
note for myself (or you) so I won't forget...
- on the test, The other side of the mirror must have a cluster with Strict load balancing... so messages will be load balanced when sent.
- on the implementation, I should add a routingType on RoutingContext where I could set the routingType = OFF, and on PostOfficeImpl:;route (probably on Bindings) I would look if the routingType on the context != null, I would ignore any routingType and just the one from routing.
- The Mirror target will set routingContext.routingType=OFF, so messages will always go to local queues on target.
- The test should be fixed with these options applied.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1106899854
> @iliya-gr say you are sending to a destination with strict load balancing... the server on other side of the mirror will then send to its cluster.
Got it. I will try to add a test case for this before Monday.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1107475259
Just to let you know, I found some time to work on it today, and I already have a test locally.. I'm pushing it shortly.
(just to avoid two people working on the same thing)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1105817140
there's an issue with this... what if the queue was sent to an internal queue and a regular queue?
This could happen on a case of a topic distribution in cluster.
although I honestly thought people would be using mirror with Federation instead of clustering, which would offer a better control on the queues and targets.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1089381090
Hi @clebertsuconic
I am just a humble programmer.
I don't see any use from unit testing this, but maybe I will be able to add integration test.
Also there are still some issues with **activemq.notifications** address, not all messages get ACKed during startup, and I was not able to figure out why.
And I can include https://issues.apache.org/jira/browse/ARTEMIS-3759 to this pull request, that can hide **notif** queue issue, but won't solve it.
Maybe, just maybe **activemq.notifications** address also should be marked as internal?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1107486554
merged it...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] asfgit closed pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
asfgit closed pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
URL: https://github.com/apache/activemq-artemis/pull/4012
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1105838144
In test I create mirror between one node of a cluster and a regular server. In reality I want to create mirror between each corresponding nodes of two different clusters.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1107490664
I amended everything on a single commit, and I added a mark on myself as a co-author (Hope you don't mind)... just to mention the discussions...
thanks a lot for this!
I am doing a release early next week (look at the dev-list disucssion where I sent a HEADS-UP)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1089331220
who are you? :O
Awesome you found this.. nice catch!
Do you have an idea on how to write a test for this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] iliya-gr commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
iliya-gr commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1105829883
> although I honestly thought people would be using mirror with Federation instead of clustering, which would offer a better control on the queues and targets.
Yeah and for everyone else it's cool async replication feature. :-)
There is also an issue on the target side witch I can't reproduce locally. One I mentioned earlier: messages from **activemq.notifications** not getting deleted. It can happen not only with **activemq.notifications** but with any queue if ACKs follows right after messages and disk is slow. Don't think that source side has something to do with it, just wanted to mention it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [activemq-artemis] clebertsuconic commented on pull request #4012: ARTEMIS-3753 Prevent sending message to internal queues on mirror
Posted by GitBox <gi...@apache.org>.
clebertsuconic commented on PR #4012:
URL: https://github.com/apache/activemq-artemis/pull/4012#issuecomment-1105893338
@iliya-gr can you take a look on #4038...
if you like to rebase against it I may close 4038.
I will think of a test for topics tomorrow... let me think over if I can find of a better solution.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@activemq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org