You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2019/07/24 21:07:00 UTC

[GitHub] [airflow] ashb edited a comment on issue #5615: [AIRFLOW-5035] Remove multiprocessing.Manager in-favour of Pipes

ashb edited a comment on issue #5615: [AIRFLOW-5035] Remove multiprocessing.Manager in-favour of Pipes
URL: https://github.com/apache/airflow/pull/5615#issuecomment-514799557
 
 
   @KevinYang21 Yeah, I'm not thrilled with the idea of a performance regression either!
   
   Basically the _possible_ regression comes from the fact that `send()`/`recv()` on the pipe will block the sending end once the small internal buffer is filled. Using a Manager had a buffer on the sending side and a thread to push messages in to the pipe as space becomes available.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services