[jira] [Created] (JAMES-3721) Browse on the Pulsar mailqueue fails with ObjectNotFoundException

["Jean Helou (Jira)" <se...@james.apache.org>]

Jean Helou created JAMES-3721:
---------------------------------

             Summary: Browse on the Pulsar mailqueue fails with ObjectNotFoundException
                 Key: JAMES-3721
                 URL: https://issues.apache.org/jira/browse/JAMES-3721
             Project: James Server
          Issue Type: Bug
          Components: pulsar, Queue
            Reporter: Jean Helou


We have identified a couple interrelated issues around the [puslar mailqueue|https://issues.apache.org/jira/browse/JAMES-3695] :

Upon acknowledging a message, the corresponding mime message was not removed from the blob store.

Upon fixing that issue (and adding the corresponding verification), we started getting more failures on the browse (the failures could also be observed on the remove).

 

Because of how pulsar works and because we allow parallel processing of messages, the browse operation can end up reading meta data of messages that have been removed or acknowledged. The metadata of acknowledged messages is not immediately  purged from pulsar. It is somewhat configurable but for a normally operating cluster acked messages can [remain readable for hours|https://pulsar.apache.org/docs/en/cookbooks-retention-expiry/#delete-messages-from-namespaces] (and forcing that to the order of seconds would badly affect the cluster operation)

 

We chose to catch the specific exception and simply ignore the corresponding mails during the browse operation.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org