You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by zhangliyun <ke...@126.com> on 2019/11/05 01:21:24 UTC

A question about skew join hint


Hi all:
  i saw skewed join hint optimization in  https://docs.azuredatabricks.net/delta/join-performance/skew-join.html.


it  is a great feature to help users to avoid the problem brought from skewed data. My question
1. which version we will have this ? i have not found the feature in the master branch by key word "+SKEW" 
2. the article is under Documentation -> Delta Lake->  Optimizations->  Optimize Join Performance -> Skew Join Optimization,
   is this feature  only in delta lake?




Best Regards
Kelly  Zhang

Fw: A question about skew join hint

Posted by Mayank Pradhan <ma...@workday.com>.
watch this thread folks.

@Eugene Koifman<ma...@workday.com> if you recall this is the same question I was asking you earlier.

-Mayank

________________________________
From: zhangliyun <ke...@126.com>
Sent: Monday, November 4, 2019 5:21 PM
To: Spark Dev List <de...@spark.apache.org>; user@spark.apache.org <us...@spark.apache.org>
Subject: A question about skew join hint


Hi all:
  i saw skewed join hint optimization in  https://docs.azuredatabricks.net/delta/join-performance/skew-join.html.

it  is a great feature to help users to avoid the problem brought from skewed data. My question
1. which version we will have this ? i have not found the feature in the master branch by key word "+SKEW"
2. the article is under Documentation -> Delta Lake->  Optimizations->  Optimize Join Performance -> Skew Join Optimization,
   is this feature  only in delta lake?


Best Regards
Kelly  Zhang