You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:24:08 UTC
[jira] [Updated] (SPARK-9595) Adding API to SparkConf for kryo
serializers registration
[ https://issues.apache.org/jira/browse/SPARK-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-9595:
--------------------------------
Labels: bulk-closed (was: )
> Adding API to SparkConf for kryo serializers registration
> ---------------------------------------------------------
>
> Key: SPARK-9595
> URL: https://issues.apache.org/jira/browse/SPARK-9595
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.3.1, 1.4.1
> Reporter: Yuhang Chen
> Priority: Minor
> Labels: bulk-closed
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Currently SparkConf has a registerKryoClasses API for kryo registration. However, this only works when you register classes. If you want to register customized kryo serializers, you'll have to extend the KryoSerializer class and write some codes.
> This is not only very inconvenient, but also require the registration to be done in compile-time, which is not always possible. Thus, I suggest another API to SparkConf for registering customized kryo serializers. It could be like this:
> def registerKryoSerializers(serializers: Map[Class[_], Serializer]): SparkConf
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org