You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/07/21 05:14:00 UTC
[jira] [Commented] (SPARK-16683) Group by does not work after
multiple joins of the same dataframe
[ https://issues.apache.org/jira/browse/SPARK-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16095790#comment-16095790 ]
Apache Spark commented on SPARK-16683:
--------------------------------------
User 'aray' has created a pull request for this issue:
https://github.com/apache/spark/pull/18697
> Group by does not work after multiple joins of the same dataframe
> -----------------------------------------------------------------
>
> Key: SPARK-16683
> URL: https://issues.apache.org/jira/browse/SPARK-16683
> Project: Spark
> Issue Type: Bug
> Components: Optimizer
> Affects Versions: 1.6.0, 1.6.1, 1.6.2, 2.0.0
> Environment: local and yarn
> Reporter: Witold Jędrzejewski
> Attachments: code_2.0.txt, Duplicates Problem Presentation.json
>
>
> When I join a dataframe, group by a field from it, then join it again by different field and group by field from it, second aggregation does not trigger.
> Minimal example showing the problem is attached as the text to paste into spark-shell (code_2.0.txt).
> The detailed description and minimal example, workaround and possible cause are in the attachment, in a form of Zeppelin notebook.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org