You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2017/03/13 03:41:04 UTC
[jira] [Created] (SPARK-19931) InMemoryTableScanExec should rewrite
output partitioning and ordering when aliasing output attributes
Liang-Chi Hsieh created SPARK-19931:
---------------------------------------
Summary: InMemoryTableScanExec should rewrite output partitioning and ordering when aliasing output attributes
Key: SPARK-19931
URL: https://issues.apache.org/jira/browse/SPARK-19931
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.1.0
Reporter: Liang-Chi Hsieh
Now InMemoryTableScanExec simply takes the outputPartitioning and outputOrdering from the associated InMemoryRelation's child.outputPartitioning and outputOrdering.
However, InMemoryTableScanExec can alias the output attributes. In this case, its outputPartitioning and outputOrdering are not correct and its parent operators can't correctly determine its data distribution.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org