You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "hpvd (via GitHub)" <gi...@apache.org> on 2024/11/04 12:10:46 UTC
[I] Messures and Doc for index freshness [pinot]
hpvd opened a new issue, #14371:
URL: https://github.com/apache/pinot/issues/14371
A part of Pinots secret sauce for speed are indexes.
Is their any info available what index freshness/delay is achievable for newly ingested data / just changed data (upsert) for the different kinds of indexes? Or on how this could be reduced?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Messures and Doc for index freshness/update [pinot]
Posted by "R-tooR (via GitHub)" <gi...@apache.org>.
R-tooR commented on issue #14371:
URL: https://github.com/apache/pinot/issues/14371#issuecomment-4561055637
During investigation noticed, that if indexes are calculated in realtime tables, they are calculated at the row ingestion moment. With that information, not sure if metrics for index availability might be useful
For indexes available only in offline segments - not sure about usefulness of metrics. Maybe those might be useful to track how much resource-using a creation of index is (e.g. creation of star-tree index).
I'm the first-time contributor, I'd appreciate any comments and suggestions on the PR I just made :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Messures and Doc for index freshness/update [pinot]
Posted by "xiangfu0 (via GitHub)" <gi...@apache.org>.
xiangfu0 commented on issue #14371:
URL: https://github.com/apache/pinot/issues/14371#issuecomment-4485035357
> Could I pick this up [@xiangfu0](https://github.com/xiangfu0) ? Looks like that issue wasn't touched since 2024
For sure, please review this issue and update :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Messures and Doc for index freshness/update [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14371:
URL: https://github.com/apache/pinot/issues/14371#issuecomment-6430552924
This issue has been automatically marked as stale because it has not had any activity in the last 150 days. It will be closed in 30 days if no further activity occurs. If this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Messures and Doc for index freshness/update [pinot]
Posted by "R-tooR (via GitHub)" <gi...@apache.org>.
R-tooR commented on issue #14371:
URL: https://github.com/apache/pinot/issues/14371#issuecomment-4484688981
Could I pick this up @xiangfu0 ? Looks like that issue wasn't touched since 2024
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org