You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "Jackie-Jiang (via GitHub)" <gi...@apache.org> on 2024/02/28 00:35:58 UTC
[I] Consuming segment flush rows significantly reduced after force commit [pinot]
Jackie-Jiang opened a new issue, #12509:
URL: https://github.com/apache/pinot/issues/12509
When a segment is force committed with segment size based flush threshold enabled, I observed that the next consuming segment flush threshold (desired rows) are significantly reduced (reset to 10000). I feel there is a bug which is causing the size threshold not properly applied during force commit. cc @sajjad-moradi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Consuming segment flush rows significantly reduced after force commit [pinot]
Posted by "sajjad-moradi (via GitHub)" <gi...@apache.org>.
sajjad-moradi commented on issue #12509:
URL: https://github.com/apache/pinot/issues/12509#issuecomment-1973795958
I believe as part of this [PR](https://github.com/apache/pinot/pull/12188/files), this issue was fixed.
Look here:
https://github.com/apache/pinot/blob/9cfce82385dfcd11eed4467c07f2409b76622d57/pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/segment/SegmentFlushThresholdComputer.java#L82-L93
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Consuming segment flush rows significantly reduced after force commit [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang closed issue #12509: Consuming segment flush rows significantly reduced after force commit
URL: https://github.com/apache/pinot/issues/12509
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org