You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Adam Binford (Jira)" <ji...@apache.org> on 2021/11/11 13:55:00 UTC

[jira] [Updated] (SPARK-37019) Add Codegen support to array higher-order-functions

     [ https://issues.apache.org/jira/browse/SPARK-37019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Adam Binford updated SPARK-37019:
---------------------------------
    Description: 
Currently all of the higher order functions use CodegenFallback. We can improve the performance of these by adding proper codegen support, so the function as well as all children can be codegen'd, and it can participate in WholeStageCodegen.

This ticket is for adding support to array-based higher-order functions.

  was:
Currently all of the higher order functions use CodegenFallback. We can improve the performance of these by adding proper codegen support, so the function as well as all children can be codegen'd, and it can participate in WholeStageCodegen.

This ticket is for adding support to ArrayTransform as the first step.

        Summary: Add Codegen support to array higher-order-functions  (was: Add Codegen support to ArrayTransform)

> Add Codegen support to array higher-order-functions
> ---------------------------------------------------
>
>                 Key: SPARK-37019
>                 URL: https://issues.apache.org/jira/browse/SPARK-37019
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.2.0
>            Reporter: Adam Binford
>            Priority: Major
>
> Currently all of the higher order functions use CodegenFallback. We can improve the performance of these by adding proper codegen support, so the function as well as all children can be codegen'd, and it can participate in WholeStageCodegen.
> This ticket is for adding support to array-based higher-order functions.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org