You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Tamás Németh (Jira)" <ji...@apache.org> on 2020/11/27 15:39:00 UTC
[jira] [Commented] (GOBBLIN-1324) Jackson version clash in
wikipedia example
[ https://issues.apache.org/jira/browse/GOBBLIN-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239730#comment-17239730 ]
Tamás Németh commented on GOBBLIN-1324:
---------------------------------------
Parquet 1.11.1 uses a version of jackson which is not compatible with the older jackson which is used in the default Gobblin Avro version.
This is the Jackson commit which caused this issue:
[https://github.com/FasterXML/jackson-core/commit/35f3ab4d0512edc2d1ce13a7f43cd75b3c63c797.]
> Jackson version clash in wikipedia example
> ------------------------------------------
>
> Key: GOBBLIN-1324
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1324
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-core
> Reporter: Tamás Németh
> Assignee: Abhishek Tiwari
> Priority: Major
>
> Based on the slack conversation it seems like the Parquet version bump introduced Jackson dependency clash in Wikipedia example:
>
>
> {code:java}
> Hi folks, seems we have introduce a new issue from some recent PR. I ran into this error for any job running in my standalone daemon. Here’s the error log: 17:37 ERROR [org.apache.gobblin.runtime.embedded.EmbeddedGobblin-thread-0] org.apache.gobblin.runtime.instance.DefaultGobblinInstanceDriverImpl$JobSpecRunnable - Job launch failed: java.lang.VerifyError: Stack map does not match the one at exception handler 77
> Exception Details:
> Location:
> com/fasterxml/jackson/databind/deser/std/StdDeserializer._parseDate(Lcom/fasterxml/jackson/core/JsonParser;Lcom/fasterxml/jackson/databind/DeserializationContext;)Ljava/util/Date; @77: astore
> Reason:
> Type ‘com/fasterxml/jackson/core/JsonParseException’ (current frame, stack[0]) is not assignable to ‘com/fasterxml/jackson/core/exc/StreamReadException’ (stack map, stack[0])
> Current Frame:
> bci: @69
> flags: { }
> locals: { ‘com/fasterxml/jackson/databind/deser/std/StdDeserializer’, ‘com/fasterxml/jackson/core/JsonParser’, ‘com/fasterxml/jackson/databind/DeserializationContext’ }
> stack: { ‘com/fasterxml/jackson/core/JsonParseException’ }
> Stackmap Frame:
> bci: @77
> flags: { }
> locals: { ‘com/fasterxml/jackson/databind/deser/std/StdDeserializer’, ‘com/fasterxml/jackson/core/JsonParser’, ‘com/fasterxml/jackson/databind/DeserializationContext’ }
> stack: { ‘com/fasterxml/jackson/core/exc/StreamReadException’ } 17:38 at com.fasterxml.jackson.databind.deser.BasicDeserializerFactory.createTreeDeserializer(BasicDeserializerFactory.java:1513)
> at com.fasterxml.jackson.databind.deser.DeserializerCache._createDeserializer2(DeserializerCache.java:409)
> at com.fasterxml.jackson.databind.deser.DeserializerCache._createDeserializer(DeserializerCache.java:349)
> at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCache2(DeserializerCache.java:264)
> at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCacheValueDeserializer(DeserializerCache.java:244)
> at com.fasterxml.jackson.databind.deser.DeserializerCache.findValueDeserializer(DeserializerCache.java:142)
> at com.fasterxml.jackson.databind.DeserializationContext.findRootValueDeserializer(DeserializationContext.java:476)
> at com.fasterxml.jackson.databind.ObjectMapper._findRootDeserializer(ObjectMapper.java:4389)
> at com.fasterxml.jackson.databind.ObjectMapper._readValue(ObjectMapper.java:4168)
> at com.fasterxml.jackson.databind.ObjectMapper.readTree(ObjectMapper.java:2577)
> at org.apache.avro.Schema$Parser.parse(Schema.java:1394)
> at org.apache.avro.Schema$Parser.parse(Schema.java:1382)
> at org.apache.gobblin.metrics.GobblinTrackingEvent.<clinit>(GobblinTrackingEvent.java:14)
> at org.apache.gobblin.metrics.event.EventSubmitter.submit(EventSubmitter.java:182)
> at org.apache.gobblin.metrics.event.TimingEvent.stop(TimingEvent.java:140)
> at org.apache.gobblin.metrics.event.TimingEvent.stop(TimingEvent.java:122)
> at org.apache.gobblin.runtime.local.LocalJobLauncher.<init>(LocalJobLauncher.java:103)
> at org.apache.gobblin.runtime.JobLauncherFactory.newJobLauncher(JobLauncherFactory.java:144)
> at org.apache.gobblin.runtime.JobLauncherFactory.newJobLauncher(JobLauncherFactory.java:107)
> at org.apache.gobblin.runtime.JobLauncherFactory.newJobLauncher(JobLauncherFactory.java:85)
> at org.apache.gobblin.runtime.job_exec.JobLauncherExecutionDriver.createLauncher(JobLauncherExecutionDriver.java:179)
> at org.apache.gobblin.runtime.job_exec.JobLauncherExecutionDriver.create(JobLauncherExecutionDriver.java:126)
> at org.apache.gobblin.runtime.job_exec.JobLauncherExecutionDriver$Launcher.launchJob(JobLauncherExecutionDriver.java:460)
> at org.apache.gobblin.runtime.instance.DefaultGobblinInstanceDriverImpl$JobSpecRunnable.run(DefaultGobblinInstanceDriverImpl.java:212)
> at org.apache.gobblin.runtime.scheduler.AbstractJobSpecScheduler$TriggerRunnable.run(AbstractJobSpecScheduler.java:177)
> at java.lang.Thread.run(Thread.java:748) 17:39 Seems it relates to some Jackson dependency issue. Anybody has any idea? {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)