You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean R. Owen (Jira)" <ji...@apache.org> on 2019/11/20 14:19:00 UTC

[jira] [Resolved] (SPARK-28751) Imporve java serializer deserialization performance

     [ https://issues.apache.org/jira/browse/SPARK-28751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean R. Owen resolved SPARK-28751.
----------------------------------
    Resolution: Won't Fix

See PR

> Imporve java serializer deserialization performance
> ---------------------------------------------------
>
>                 Key: SPARK-28751
>                 URL: https://issues.apache.org/jira/browse/SPARK-28751
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Xianyang Liu
>            Priority: Major
>
> Improve the performance of java serializer deserialization by caching the resolved class. Java serializer is used in many places: closure, RPC and others. This change could improve the performance of deserialization 1.3X ~ 1.5X. Especially for java primitive instances.
> And also, add new UT tests and benchmarks case.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org