You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Thomas Graves (Jira)" <ji...@apache.org> on 2020/07/16 14:51:00 UTC

[jira] [Created] (SPARK-32332) AQE doesn't adequately allow for Columnar Processing extension

Thomas Graves created SPARK-32332:
-------------------------------------

             Summary: AQE doesn't adequately allow for Columnar Processing extension 
                 Key: SPARK-32332
                 URL: https://issues.apache.org/jira/browse/SPARK-32332
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Thomas Graves


In SPARK-27396 we added support to extended Columnar Processing. We did the initial work as to what we thought was sufficient but adaptive query execution was being developed at the same time.

We have discovered that the changes made to AQE are not sufficient for users to properly extend it for columnar processing because AQE hardcodes to look for specific classes/execs.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org