You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2026/10/20 07:27:00 UTC

[jira] [Assigned] (SPARK-59532) Optimize VectorDotProduct for foldable inputs

     [ https://issues.apache.org/jira/browse/SPARK-59532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ruifeng Zheng reassigned SPARK-59532:
-------------------------------------

    Assignee: Ruifeng Zheng

> Optimize VectorDotProduct for foldable inputs
> ---------------------------------------------
>
>                 Key: SPARK-59532
>                 URL: https://issues.apache.org/jira/browse/SPARK-59532
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML, SQL
>    Affects Versions: 5.0.0
>            Reporter: Ruifeng Zheng
>            Assignee: Ruifeng Zheng
>            Priority: Major
>              Labels: pull-request-available
>
> VectorDotProduct decodes both vector structs and accesses both operands through ArrayData for every input row. When one operand is foldable, evaluate it once during code generation and cache its size, indices, and values using primitive data. Preserve the existing fallback for two dynamic operands and cover dense and sparse vectors in both operand positions.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org