You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/07/16 15:06:00 UTC
[jira] [Commented] (SPARK-32332) AQE doesn't adequately allow for
Columnar Processing extension
[ https://issues.apache.org/jira/browse/SPARK-32332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159273#comment-17159273 ]
Apache Spark commented on SPARK-32332:
--------------------------------------
User 'andygrove' has created a pull request for this issue:
https://github.com/apache/spark/pull/29134
> AQE doesn't adequately allow for Columnar Processing extension
> ---------------------------------------------------------------
>
> Key: SPARK-32332
> URL: https://issues.apache.org/jira/browse/SPARK-32332
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Thomas Graves
> Priority: Major
>
> In SPARK-27396 we added support to extended Columnar Processing. We did the initial work as to what we thought was sufficient but adaptive query execution was being developed at the same time.
> We have discovered that the changes made to AQE are not sufficient for users to properly extend it for columnar processing because AQE hardcodes to look for specific classes/execs.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org