You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by zhangliyun <ke...@126.com> on 2019/11/05 01:21:24 UTC
A question about skew join hint
Hi all:
i saw skewed join hint optimization in https://docs.azuredatabricks.net/delta/join-performance/skew-join.html.
it is a great feature to help users to avoid the problem brought from skewed data. My question
1. which version we will have this ? i have not found the feature in the master branch by key word "+SKEW"
2. the article is under Documentation -> Delta Lake-> Optimizations-> Optimize Join Performance -> Skew Join Optimization,
is this feature only in delta lake?
Best Regards
Kelly Zhang
Fw: A question about skew join hint
Posted by Mayank Pradhan <ma...@workday.com>.
watch this thread folks.
@Eugene Koifman<ma...@workday.com> if you recall this is the same question I was asking you earlier.
-Mayank
________________________________
From: zhangliyun <ke...@126.com>
Sent: Monday, November 4, 2019 5:21 PM
To: Spark Dev List <de...@spark.apache.org>; user@spark.apache.org <us...@spark.apache.org>
Subject: A question about skew join hint
Hi all:
i saw skewed join hint optimization in https://docs.azuredatabricks.net/delta/join-performance/skew-join.html.
it is a great feature to help users to avoid the problem brought from skewed data. My question
1. which version we will have this ? i have not found the feature in the master branch by key word "+SKEW"
2. the article is under Documentation -> Delta Lake-> Optimizations-> Optimize Join Performance -> Skew Join Optimization,
is this feature only in delta lake?
Best Regards
Kelly Zhang