[jira] [Commented] (SPARK-7042) Spark version of akka-actor_2.11 is not compatible with the official akka-actor_2.11 2.3.x

["Konstantin Shaposhnikov (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545375#comment-14545375 ] 

Konstantin Shaposhnikov commented on SPARK-7042:
------------------------------------------------

There is nothing wrong with the standard Akka 2.11 build. In fact we have a custom build of Spark now that uses standard Akka 2.3.9 from maven central repository without any problems.

The error appears only with the custom build of akka (because it was compiled with buggy version of Scala) that comes with spark by default. 

I agree that number of users affected by this problem is probably quite small (only 1? ;)

> Spark version of akka-actor_2.11 is not compatible with the official akka-actor_2.11 2.3.x
> ------------------------------------------------------------------------------------------
>
>                 Key: SPARK-7042
>                 URL: https://issues.apache.org/jira/browse/SPARK-7042
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.3.1
>            Reporter: Konstantin Shaposhnikov
>            Priority: Minor
>
> When connecting to a remote Spark cluster (that runs Spark branch-1.3 built with Scala 2.11) from an application that uses akka 2.3.9 I get the following error:
> {noformat}
> 2015-04-22 09:01:38,924 - [WARN] - [akka.remote.ReliableDeliverySupervisor] [sparkDriver-akka.actor.default-dispatcher-5] -
> Association with remote system [akka.tcp://sparkExecutor@server:59007] has failed, address is now gated for [5000] ms.
> Reason is: [akka.actor.Identify; local class incompatible: stream classdesc serialVersionUID = -213377755528332889, local class serialVersionUID = 1].
> {noformat}
> It looks like akka-actor_2.11 2.3.4-spark that is used by Spark has been built using Scala compiler 2.11.0 that ignores SerialVersionUID annotations (see https://issues.scala-lang.org/browse/SI-8549).
> The following steps can resolve the issue:
> - re-build the custom akka library that is used by Spark with the more recent version of Scala compiler (e.g. 2.11.6) 
> - deploy a new version (e.g. 2.3.4.1-spark) to a maven repo
> - update version of akka used by spark (master and 1.3 branch)
> I would also suggest to upgrade to the latest version of akka 2.3.9 (or 2.3.10 that should be released soon).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org