You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "marin-ma (via GitHub)" <gi...@apache.org> on 2024/08/16 10:04:51 UTC
[I] [VL] Umbrella issue for sort-based shuffle [incubator-gluten]
marin-ma opened a new issue, #6896:
URL: https://github.com/apache/incubator-gluten/issues/6896
### Description
- Initial patch: https://github.com/apache/incubator-gluten/pull/6475 (TPCDS SF3T 40000 partitions 1.13x vs hash)
- follow up: https://github.com/apache/incubator-gluten/pull/6579
- follow up: https://github.com/apache/incubator-gluten/pull/6628
- [Performance] Reduce shuffle spill: https://github.com/apache/incubator-gluten/pull/6639 (1.25x)
- [Performance] Reduce shuffle writer memory waste: https://github.com/apache/incubator-gluten/pull/6727 (1.3x)
- [UI] display shuffle_writer_type: https://github.com/apache/incubator-gluten/pull/6799
- [Performance] Optimize c2r in shuffle. https://github.com/apache/incubator-gluten/pull/6782 (Pending on Velox PR)
- [Bug fix] #6822 https://github.com/apache/incubator-gluten/pull/6832
- [Bug fix] #6863 https://github.com/apache/incubator-gluten/pull/6869
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Umbrella issue for sort-based shuffle [incubator-gluten]
Posted by "FelixYBW (via GitHub)" <gi...@apache.org>.
FelixYBW commented on issue #6896:
URL: https://github.com/apache/incubator-gluten/issues/6896#issuecomment-2295154118
Good summary! thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org