You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/12/05 22:43:13 UTC

[jira] [Updated] (SPARK-4761) With JDBC server, set Kryo as default serializer and disable reference tracking

     [ https://issues.apache.org/jira/browse/SPARK-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Patrick Wendell updated SPARK-4761:
-----------------------------------
    Fix Version/s: 1.2.0

> With JDBC server, set Kryo as default serializer and disable reference tracking
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-4761
>                 URL: https://issues.apache.org/jira/browse/SPARK-4761
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Patrick Wendell
>            Assignee: Cheng Lian
>            Priority: Blocker
>             Fix For: 1.2.0
>
>
> I saw some regression in 1.2 Spark SQL due to our broadcast change which requires significantly more serialization. It would be good if when the JDBC server is running it automatically sets the serializer to Kryo and disables Kryo reference tracking.
> Doing this while still honoring a user-provided serializer is tricky. I think the best way is to expose an internal (private) constructor to SparkConf that takes a set of lowest-precedence defaults. Those could get merged in with the lowest precedence before the config file is read.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org