You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@james.apache.org by GitBox <gi...@apache.org> on 2021/05/23 07:55:51 UTC

[GitHub] [james-project] chibenwa opened a new pull request #454: [PERFORMANCE] AmqpForwardAttribute should reuse connection

chibenwa opened a new pull request #454:
URL: https://github.com/apache/james-project/pull/454


   Today one connection and one channel is opened per processed
   emails. Connections and channels are long lived objects,
   made to be reused.
   
   Flame graphs showed that this AMQP mailet represents ~1%
   of CPU occupation with just about 30 mail/sec. Note that
   92% of this time is used opening/closing connections/channels.
   
   Moving connection and channel initialization at mailet
   initialization enables reuse and leads to dramatic enhancements
   of the performances of that very mailet. Note that retries are
   in place in case Rabbit is not up right at start - common with
   IE docker-compose.
   
   The testing strategy relying on mocks is brittle. Given that we
   have full-fledged integration tests in place, we can get rid of
   these annoying mock-based tests.
   
   ## Before
   
   ![newcon](https://user-images.githubusercontent.com/6928740/119252490-c5bfaa00-bbd6-11eb-832b-68c7677fa154.png)
   
   ![newcon2](https://user-images.githubusercontent.com/6928740/119252492-c9533100-bbd6-11eb-8ba8-9469a0455890.png)
   
   ## After
   
   ![resuecon](https://user-images.githubusercontent.com/6928740/119252497-d112d580-bbd6-11eb-8ed3-87f3d9d4e432.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@james.apache.org
For additional commands, e-mail: notifications-help@james.apache.org


[GitHub] [james-project] chibenwa merged pull request #454: [PERFORMANCE] AmqpForwardAttribute should reuse connection

Posted by GitBox <gi...@apache.org>.
chibenwa merged pull request #454:
URL: https://github.com/apache/james-project/pull/454


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@james.apache.org
For additional commands, e-mail: notifications-help@james.apache.org


[GitHub] [james-project] chibenwa commented on pull request #454: [PERFORMANCE] AmqpForwardAttribute should reuse connection

Posted by GitBox <gi...@apache.org>.
chibenwa commented on pull request #454:
URL: https://github.com/apache/james-project/pull/454#issuecomment-846561562


   AMQP channels are not threadsafe and should not be shared across thread.
   
    - [ ] We should create a new `mailet-amqp` maven project
    - [ ] Depends on `bckens-rabbitmq` to reuse `SimpleConnectionPool` and `ReactorRabbitMQChannelPool`
    - [ ] Clean up AMQP dependency out of `mailet-standard`
    - [ ] Finally we should take care that we should be able to maintain a separated AMQP host than the main one.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@james.apache.org
For additional commands, e-mail: notifications-help@james.apache.org


[GitHub] [james-project] Arsnael commented on a change in pull request #454: [PERFORMANCE] AmqpForwardAttribute should reuse connection

Posted by GitBox <gi...@apache.org>.
Arsnael commented on a change in pull request #454:
URL: https://github.com/apache/james-project/pull/454#discussion_r637679086



##########
File path: pom.xml
##########
@@ -958,6 +958,11 @@
                 <version>${project.version}</version>
                 <type>test-jar</type>
             </dependency>
+            <dependency>
+                <groupId>${james.groupId}</groupId>
+                <artifactId>apache-mailet-amqp</artifactId>

Review comment:
       idem




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@james.apache.org
For additional commands, e-mail: notifications-help@james.apache.org