You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/07/07 00:07:00 UTC
[jira] [Commented] (SPARK-21333) joinWith documents and analysis
allow invalid join types
[ https://issues.apache.org/jira/browse/SPARK-21333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077381#comment-16077381 ]
Apache Spark commented on SPARK-21333:
--------------------------------------
User 'coreywoodfield' has created a pull request for this issue:
https://github.com/apache/spark/pull/18462
> joinWith documents and analysis allow invalid join types
> --------------------------------------------------------
>
> Key: SPARK-21333
> URL: https://issues.apache.org/jira/browse/SPARK-21333
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 2.1.1
> Reporter: Corey Woodfield
> Priority: Minor
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> joinWith returns a Dataset<Tuple2>, but left_semi and left_anti (which only return things from one side of the join) are listed as acceptable join types in the documentation, and an error is not thrown until spark gets to the joining part, rather than in the analysis phase. These join types should be removed from the documentation, and this error should be caught earlier
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org