You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/08/16 02:19:49 UTC

[GitHub] [spark] ConeyLiu opened a new pull request #25470: [SPARK-28751][Core] Imporve java serializer deserialization performance

ConeyLiu opened a new pull request #25470: [SPARK-28751][Core] Imporve java serializer deserialization performance
URL: https://github.com/apache/spark/pull/25470
 
 
   ### What changes were proposed in this pull request?
   
   Improve the performance of java serializer deserialization by caching the resolved class. Java serializer is used in many places: closure, RPC and others. This change could improve the performance of deserialization 1.3X ~ 1.5X.  Especially for java primitive instances. 
   
   And also, add new UT tests and benchmarks case.
   
   ### Why are the changes needed?
   
   This change could improve the performance of deserialization 1.3X ~ 1.5X.  Especially for java primitive instances. 
   
   
   ### Does this PR introduce any user-facing change?
   
   Add new config to enable disable this feature, default is true. This shouldn't influence the existed code.
   
   
   ### How was this patch tested?
   New UT tests.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org