You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/12/09 08:14:17 UTC
[GitHub] [pinot] 61yao opened a new issue, #9955: [multistage] [bug] Too small capacity for In memory mailbox queue
61yao opened a new issue, #9955:
URL: https://github.com/apache/pinot/issues/9955
DEFAULT_CHANNEL_CAPACITY for each mailbox is set to 5.
5 is a pretty small number.
Whenever we have a MailboxSendOperator that produces more than 5 block really fast before MailboxReceiveOperator has a chance to run, we will run into error since MailboxSendOperator doesn't retry.
Propose solution
1) Increase the DEFAULT_CHANNEL_CAPACITY. This is easy to do. but this will add memory pressure
2) Return an non-op block after mailbox send reaches 5. this is ideal. however, it needs some coordination to make it happen.
@walterddr @ankitsultana FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] agavra commented on issue #9955: [multistage] [bug] Limited capacity for mailbox queue causes mailbox to drop
Posted by GitBox <gi...@apache.org>.
agavra commented on issue #9955:
URL: https://github.com/apache/pinot/issues/9955#issuecomment-1357946250
This is still relevant, but mitigated with #9999
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org