You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2017/07/19 22:24:00 UTC
[jira] [Resolved] (SPARK-21333) joinWith documents and analysis
allow invalid join types
[ https://issues.apache.org/jira/browse/SPARK-21333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li resolved SPARK-21333.
-----------------------------
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
> joinWith documents and analysis allow invalid join types
> --------------------------------------------------------
>
> Key: SPARK-21333
> URL: https://issues.apache.org/jira/browse/SPARK-21333
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 2.1.1, 2.2.0
> Reporter: Corey Woodfield
> Assignee: Corey Woodfield
> Priority: Minor
> Fix For: 2.2.1, 2.3.0
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> joinWith returns a Dataset<Tuple2>, but left_semi and left_anti (which only return things from one side of the join) are listed as acceptable join types in the documentation, and an error is not thrown until spark gets to the joining part, rather than in the analysis phase. These join types should be removed from the documentation, and this error should be caught earlier
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org