[jira] [Created] (SPARK-17734) inner equi-join shorthand that returns Datasets, like DataFrame already has

["Leif Warner (JIRA)" <ji...@apache.org>]

Leif Warner created SPARK-17734:
-----------------------------------

             Summary: inner equi-join shorthand that returns Datasets, like DataFrame already has
                 Key: SPARK-17734
                 URL: https://issues.apache.org/jira/browse/SPARK-17734
             Project: Spark
          Issue Type: Wish
            Reporter: Leif Warner
            Priority: Minor


There's an existing ".join(right: Dataset[_], usingColumn: String): DataFrame" method on Dataset.

Would appreciate it if a variant that returns typed Datasets would also available.

If you write a join that contains the common column name name, you get an AnalysisException thrown because that's ambiguous, e.g:
$"foo" === $"foo"
So I wrote table1.toDF()("foo") === table2.toDF()("foo"), but that's a little error prone, and coworkers considered it a hack and didn't want to use it, because it "mixes DataFrame and Dataset api".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org