You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by "advancedxy (via GitHub)" <gi...@apache.org> on 2023/04/23 11:27:26 UTC
[GitHub] [incubator-uniffle] advancedxy commented on issue #838: [Improvement] Better support for AQE sortMergeJoin -> broadcastHashJoin
advancedxy commented on issue #838:
URL: https://github.com/apache/incubator-uniffle/issues/838#issuecomment-1519041507
> For a pity, sometimes the partial partition is so huge, but the broadcastHashJoin won't optimize skew join. This optimization will be solved by spark community ASSP
If skewed join should not be converted into broadcast join, users should disable broadcast join or lower threshold for broadcast join by tweaking relating configurations.
I didn't see how that a spark patch is related, even if the patch was to release users from manually setting here, I don't think the patch belongs to Uniffle's project. However we can add documentations about that cases.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org