You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zuston (via GitHub)" <gi...@apache.org> on 2025/11/28 07:19:58 UTC
[PR] [VL] Fast fail or resend data to uniffle ASSP [incubator-gluten]
zuston opened a new pull request, #11213:
URL: https://github.com/apache/incubator-gluten/pull/11213
## What changes are proposed in this pull request?
Uniffle’s partition reassignment mechanism enables fast switching to alternative shuffle servers, improving performance and stability. However, in the previous Uniffle integration with Gluten, this mechanism did not function properly due to a missing trigger, which could cause significant partition backpressure without activating multi shuffle-server load balancing.
This PR also enables fast fail for the shuffle writer in case any data is lost.
## How was this patch tested?
Existing tests are sufficient
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [VL] Fast fail or resend data to uniffle ASSP [incubator-gluten]
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on PR #11213:
URL: https://github.com/apache/incubator-gluten/pull/11213#issuecomment-3600608707
Could you help take a look? @zhouyuan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [VL] Fast fail or resend data to uniffle ASSP [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan merged PR #11213:
URL: https://github.com/apache/incubator-gluten/pull/11213
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org