You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2026/09/09 12:25:00 UTC

[jira] [Resolved] (SPARK-59313) Avoid serializing FeedForwardModel scratch buffers

     [ https://issues.apache.org/jira/browse/SPARK-59313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ruifeng Zheng resolved SPARK-59313.
-----------------------------------
    Fix Version/s: 4.4.0
       Resolution: Fixed

Issue resolved by pull request 58608
[https://github.com/apache/spark/pull/58608]

> Avoid serializing FeedForwardModel scratch buffers
> --------------------------------------------------
>
>                 Key: SPARK-59313
>                 URL: https://issues.apache.org/jira/browse/SPARK-59313
>             Project: Spark
>          Issue Type: Sub-task
>          Components: ML
>    Affects Versions: 5.0.0
>            Reporter: Ruifeng Zheng
>            Assignee: Ruifeng Zheng
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.4.0
>
>
> FeedForwardModel lazily allocates outputs and deltas as reusable scratch buffers for forward and gradient computations. Mark them transient because they can be recreated after deserialization and otherwise cached batch matrices are unnecessarily serialized with the model.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org