You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kevin Tham (JIRA)" <ji...@apache.org> on 2015/07/09 20:17:04 UTC
[jira] [Comment Edited] (SPARK-8332) NoSuchMethodError:
com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620975#comment-14620975 ]
Kevin Tham edited comment on SPARK-8332 at 7/9/15 6:16 PM:
-----------------------------------------------------------
I had no issue having play-json_2.11:2.4.0 (which depends on jackson 2.5.3) in my SBT build with Spark 1.3, and then upgrading to Spark 1.4 leads me to not be able to do an "sc.parallelize(someCollection)" where the collection is a Seq[(TreeMap[String, Double], Double)] and am able to reproduce the error Jonathan Kelly saw with (Exception in thread "main" com.fasterxml.jackson.databind.JsonMappingException: Could not find creator property with name 'id' (in class org.apache.spark.rdd.RDDOperationScope))
I would help when I have time to figure out why, but I'm interested to see what commit caused this and the actual cause of this error. This is causing us to stick with Spark 1.3 for now.
I hope we can prioritize this JIRA for the next 1.4.x release
was (Author: ktham):
I had no issue having play-json_2.11:2.4.0 (which depends on jackson 2.5.3) in my SBT build with Spark 1.3, and then upgrading to Spark 1.4 leads me to not be able to do an "sc.parallelize(someCollection)" where the collection is a Seq[(TreeMap[String, Double], Double)] and am able to reproduce the error Jonathan Kelly saw with (Exception in thread "main" com.fasterxml.jackson.databind.JsonMappingException: Could not find creator property with name 'id' (in class org.apache.spark.rdd.RDDOperationScope))
I would help when I have time to figure out why, but I'm interested to see what commit caused this and the actual cause of this error. This is causing us to stick with Spark 1.3 for now.
> NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer
> ----------------------------------------------------------------------------------
>
> Key: SPARK-8332
> URL: https://issues.apache.org/jira/browse/SPARK-8332
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.4.0
> Environment: spark 1.4 & hadoop 2.3.0-cdh5.0.0
> Reporter: Tao Li
> Priority: Critical
> Labels: 1.4.0, NoSuchMethodError, com.fasterxml.jackson
>
> I complied new spark 1.4.0 version.
> But when I run a simple WordCount demo, it throws NoSuchMethodError
> {code}
> java.lang.NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer
> {code}
> I found out that the default "fasterxml.jackson.version" is 2.4.4.
> Is there any wrong or conflict with the jackson version?
> Or is there possibly some project maven dependency containing the wrong version of jackson?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org