You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@celeborn.apache.org by "chenkovsky (via GitHub)" <gi...@apache.org> on 2025/03/02 14:11:18 UTC
[PR] [CELEBORN-1888] Worker Metric Collect for Auto Scaling [celeborn]
chenkovsky opened a new pull request, #3126:
URL: https://github.com/apache/celeborn/pull/3126
### What changes were proposed in this pull request?
it's a subtask in CIP-13: support auto scaling. This PR allows master collect workload metrics from workers.
### Why are the changes needed?
In CIP-13, master decides whether it's time to scaling up or down based on workload metrics. Master can also use workload metrics for other purposes, e.g. balance workload.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Unit Test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [CELEBORN-1888][CIP-13] Worker Metric Collect for Auto Scaling [celeborn]
Posted by "JoonPark1 (via GitHub)" <gi...@apache.org>.
JoonPark1 commented on PR #3126:
URL: https://github.com/apache/celeborn/pull/3126#issuecomment-3643555674
Hey @chenkovsky. Is this effort still ongoing to enable auto-scaling for celeborn according to the CIP-13 doc proposal (https://docs.google.com/document/d/1MzkrkoXP90I5IeXsxfMvk5kQGe5Kp9GB1KWrjC3O8VE/)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [CELEBORN-1888][CIP-13] Worker Metric Collect for Auto Scaling [celeborn]
Posted by "chenkovsky (via GitHub)" <gi...@apache.org>.
chenkovsky closed pull request #3126: [CELEBORN-1888][CIP-13] Worker Metric Collect for Auto Scaling
URL: https://github.com/apache/celeborn/pull/3126
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org