You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2020/08/14 08:09:00 UTC
[jira] [Resolved] (SPARK-32590) Remove fullOutput from
RowDataSourceScanExec
[ https://issues.apache.org/jira/browse/SPARK-32590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-32590.
---------------------------------
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29415
[https://github.com/apache/spark/pull/29415]
> Remove fullOutput from RowDataSourceScanExec
> --------------------------------------------
>
> Key: SPARK-32590
> URL: https://issues.apache.org/jira/browse/SPARK-32590
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.1.0
> Reporter: Huaxin Gao
> Assignee: Huaxin Gao
> Priority: Minor
> Fix For: 3.1.0
>
>
> `RowDataSourceScanExec` requires the full output instead of the scan output after column pruning. However, in v2 code path, we don't have the full output anymore so we just pass the pruned output. `RowDataSourceScanExec.fullOutput` is actually meaningless so we should remove it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org