You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "tibrewalpratik17 (via GitHub)" <gi...@apache.org> on 2023/08/01 19:21:40 UTC
[GitHub] [pinot] tibrewalpratik17 opened a new issue, #11240: Tenant isolation / better task schedule prioritisation in minions
tibrewalpratik17 opened a new issue, #11240:
URL: https://github.com/apache/pinot/issues/11240
At present, there is no way to associate specific minion hosts to execute tasks for a set of tables or prioritise task for those tables.
This is similar to tenancy model we have for broker and server.
One idea is to have an additional config in tables: `minionTenant` and use minion instance tags to assign those instances to execute tasks for those tables. This will also help in attribution of costs for the minion nodes to be simplified.
Another approach can be to have some scheduling logic in minions to prioritise tasks for table A over table B based on some config parameter.
Related slack thread: https://apache-pinot.slack.com/archives/C013WKLT5T7/p1690229524236789
cc @atris
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] atris commented on issue #11240: Tenant isolation / better task schedule prioritisation in minions
Posted by "atris (via GitHub)" <gi...@apache.org>.
atris commented on issue #11240:
URL: https://github.com/apache/pinot/issues/11240#issuecomment-1663443114
Thanks for the inputs @Jackie-Jiang . I am working on a WIP right now and will post soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #11240: Tenant isolation / better task schedule prioritisation in minions
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #11240:
URL: https://github.com/apache/pinot/issues/11240#issuecomment-1662819235
cc @snleee
Adding minion tenant sounds good. We might want to add it to the tenant config, but also allow overriding it on a per task basis in case user want to run a task type on a given tenant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Tenant isolation / better task schedule prioritisation in minions [pinot]
Posted by "tibrewalpratik17 (via GitHub)" <gi...@apache.org>.
tibrewalpratik17 closed issue #11240: Tenant isolation / better task schedule prioritisation in minions
URL: https://github.com/apache/pinot/issues/11240
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Tenant isolation / better task schedule prioritisation in minions [pinot]
Posted by "tibrewalpratik17 (via GitHub)" <gi...@apache.org>.
tibrewalpratik17 commented on issue #11240:
URL: https://github.com/apache/pinot/issues/11240#issuecomment-2461437608
Closing this as it is superseded by #12698.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org