You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/11/01 16:48:58 UTC
[jira] [Commented] (SPARK-16839) CleanupAliases may leave redundant
aliases at end of analysis state
[ https://issues.apache.org/jira/browse/SPARK-16839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15625966#comment-15625966 ]
Apache Spark commented on SPARK-16839:
--------------------------------------
User 'hvanhovell' has created a pull request for this issue:
https://github.com/apache/spark/pull/15718
> CleanupAliases may leave redundant aliases at end of analysis state
> -------------------------------------------------------------------
>
> Key: SPARK-16839
> URL: https://issues.apache.org/jira/browse/SPARK-16839
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.1, 2.0.0
> Reporter: Eyal Farago
> Assignee: Eyal Farago
> Priority: Minor
> Labels: alias, analysis, analyzers, sql, struct
> Fix For: 2.1.0
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> [SPARK-9634] [SPARK-9323] [SQL] introduced CleanupReferences which removes unnecessary Aliases while keeping required ones such as top level Projection and struct attributes. this mechanism is implemented by maintaining a boolean flag during a top-down expression transformation, I found a case where this mechanism leaves redundant aliases in the tree (within a right sibling of a create_struct node).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org