You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "JasonLeeWeiHern (via GitHub)" <gi...@apache.org> on 2023/09/11 09:18:05 UTC
[GitHub] [pinot] JasonLeeWeiHern opened a new issue, #11562: Add protection to Pinot upon reload of table
JasonLeeWeiHern opened a new issue, #11562:
URL: https://github.com/apache/pinot/issues/11562
I experience this issue upon configuring my star tree index. I moved a high cardinality col from the top of the dimensionSplitOrder to the bottom which 3x my star tree. Upon reload of the table, my cluster faced high CPU and memory which killed my cluster. I couldn't stop the reload of the segments and the only way is to disable my table. It could be good if Pinot could stop the reload with warning/error messages telling me that reload has stopped as my star tree 3x in size.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Add protection to Pinot upon reload of table [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #11562: Add protection to Pinot upon reload of table
URL: https://github.com/apache/pinot/issues/11562
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Add protection to Pinot upon reload of table [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #11562:
URL: https://github.com/apache/pinot/issues/11562#issuecomment-6430555748
This issue has been closed because it has been inactive for 180 days. If you believe this issue is still relevant, please feel free to reopen it or create a new issue. Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #11562: Add protection to Pinot upon reload of table
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #11562:
URL: https://github.com/apache/pinot/issues/11562#issuecomment-1716959378
Aborting a submitted reload request is a good feature to have, but even if we abort it, server will load the segments when it starts the next time, which will trigger the star-tree creation. One solution I can think of is to add a node limit to the star-tree index config, and not creating the star-tree when it hits that limit. Unfortunately in order to know star-tree is too large, each segment needs to try generating the star-tree once and realize it cannot be generated
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Add protection to Pinot upon reload of table [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #11562:
URL: https://github.com/apache/pinot/issues/11562#issuecomment-5824546463
This issue has been automatically marked as stale because it has not had any activity in the last 150 days. It will be closed in 30 days if no further activity occurs. If this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org