You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/02/02 20:24:40 UTC
[GitHub] [incubator-pinot] daniellavoie opened a new issue #6526: Make minion workers stateless
daniellavoie opened a new issue #6526:
URL: https://github.com/apache/incubator-pinot/issues/6526
While minion workers are stateless by nature, the task framework requires them to register with a specific `instance_id` to Helix. Minion workers tends to be scaled up and down based fluctuant workload requirements. While it does not prevent the system from worker, scaled down instances will remain as DEAD in the cluster manager.
If Pinot includes a cleanup job for minion instances, then we could update the Helm chart to move the minion pods from a statefulset to a stateless deployment.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 closed issue #6526: Make minion workers stateless
Posted by GitBox <gi...@apache.org>.
fx19880617 closed issue #6526:
URL: https://github.com/apache/incubator-pinot/issues/6526
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6526: Make minion workers stateless
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6526:
URL: https://github.com/apache/incubator-pinot/issues/6526#issuecomment-773667720
#6543 Pinot code change on cleaning up dead minion instances from helix.
K8s changes will follow once this PR is checked in.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6526: Make minion workers stateless
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6526:
URL: https://github.com/apache/incubator-pinot/issues/6526#issuecomment-773667720
#6543 Pinot code change on cleaning up dead minion instances from helix.
K8s changes will follow once this PR is checked in.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org