You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Jared Stehler <ja...@intellifylearning.com> on 2017/12/14 20:05:23 UTC

Fenzo NoClassDefFoundError: ObjectMapper

Getting the following error on app master startup with flink-mesos 1.4.0:

ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.util.concurrent.FutureTask.get(FutureTask.java:192)
    at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
    at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
    at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
...
(17 additional frame(s) were not displayed)

NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
    at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
    at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
    at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
    at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
...
(6 additional frame(s) were not displayed)

ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
...
(10 additional frame(s) were not displayed)


--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703

Re: Fenzo NoClassDefFoundError: ObjectMapper

Posted by Jared Stehler <ja...@intellifylearning.com>.
No problem, thanks! 

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



> On Dec 14, 2017, at 3:59 PM, Eron Wright <er...@gmail.com> wrote:
> 
> Jared, I think you're correct that the shaded `ObjectMapper` is missing.   Based on the above details and a quick look at the Fenzo code, it appears that this bug is expressed when you've configured some hard constraints that Mesos couldn't satisfy.  Do you agree?  Thanks also for suggesting a fix, would you mind annotating FLINK-8265?
> 
> https://issues.apache.org/jira/browse/FLINK-8265 <https://issues.apache.org/jira/browse/FLINK-8265>
> 
> Sorry about this!
>  
> Eron
> 
> 
> On Thu, Dec 14, 2017 at 12:17 PM, Jared Stehler <jared.stehler@intellifylearning.com <ma...@intellifylearning.com>> wrote:
> Possibly missing an include for jackson here in the flink-mesos pom?
> 
> 							<artifactSet>
> 								<includes combine.children="append">
> 									<include>com.google.protobuf:protobuf-java</include>
> 									<include>org.apache.mesos:mesos</include>
> 									<include>com.netflix.fenzo:fenzo-core</include>
> 								</includes>
> 							</artifactSet>
> 							<relocations combine.children="append">
> 								<relocation>
> 									<pattern>com.google.protobuf</pattern>
> 									<shadedPattern>org.apache.flink.mesos.shaded.com.google.protobuf</shadedPattern>
> 								</relocation>
> 								<relocation>
> 									<pattern>com.fasterxml.jackson</pattern>
> 									<shadedPattern>org.apache.flink.mesos.shaded.com <http://flink.mesos.shaded.com/>.fasterxml.jackson</shadedPattern>
> 								</relocation>
> 							</relocations>
> 
> --
> Jared Stehler
> Chief Architect - Intellify Learning
> o: 617.701.6330 x703 <tel:(617)%20701-6330>
> 
> 
> 
>> On Dec 14, 2017, at 3:10 PM, Jared Stehler <jared.stehler@intellifylearning.com <ma...@intellifylearning.com>> wrote:
>> 
>> I see a shaded jackson class with jackson2 in the package, but none with the path shown below.
>> 
>> --
>> Jared Stehler
>> Chief Architect - Intellify Learning
>> o: 617.701.6330 x703 <tel:(617)%20701-6330>
>> 
>> 
>> 
>>> On Dec 14, 2017, at 3:05 PM, Jared Stehler <jared.stehler@intellifylearning.com <ma...@intellifylearning.com>> wrote:
>>> 
>>> Getting the following error on app master startup with flink-mesos 1.4.0:
>>> 
>>> ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>>>     at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>>>     at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>>>     at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
>>>     at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
>>>     at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
>>> ...
>>> (17 additional frame(s) were not displayed)
>>> 
>>> NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>>>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
>>>     at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
>>>     at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
>>>     at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
>>>     at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
>>> ...
>>> (6 additional frame(s) were not displayed)
>>> 
>>> ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
>>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
>>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
>>> ...
>>> (10 additional frame(s) were not displayed)
>>> 
>>> 
>>> --
>>> Jared Stehler
>>> Chief Architect - Intellify Learning
>>> o: 617.701.6330 x703 <tel:(617)%20701-6330>
>>> 
>>> 
>>> 
>> 
> 
>

Re: Fenzo NoClassDefFoundError: ObjectMapper

Posted by Eron Wright <er...@gmail.com>.
Jared, I think you're correct that the shaded `ObjectMapper` is missing.
 Based on the above details and a quick look at the Fenzo code, it appears
that this bug is expressed when you've configured some hard constraints
that Mesos couldn't satisfy.  Do you agree?  Thanks also for suggesting a
fix, would you mind annotating FLINK-8265?

https://issues.apache.org/jira/browse/FLINK-8265

Sorry about this!

Eron


On Thu, Dec 14, 2017 at 12:17 PM, Jared Stehler <
jared.stehler@intellifylearning.com> wrote:

> Possibly missing an include for jackson here in the flink-mesos pom?
>
> <artifactSet>
> * <includes combine.children="append">*
> <include>com.google.protobuf:protobuf-java</include>
> <include>org.apache.mesos:mesos</include>
> <include>com.netflix.fenzo:fenzo-core</include>
> </includes>
> </artifactSet>
> <relocations combine.children="append">
> <relocation>
> <pattern>com.google.protobuf</pattern>
> <shadedPattern>org.apache.flink.mesos.shaded.com.google.
> protobuf</shadedPattern>
> </relocation>
> <relocation>
> <pattern>com.fasterxml.jackson</pattern>
> <shadedPattern>org.apache.flink.mesos.shaded.com.fasterxml.jackson</
> shadedPattern>
> </relocation>
> </relocations>
>
> --
> Jared Stehler
> Chief Architect - Intellify Learning
> o: 617.701.6330 x703 <(617)%20701-6330>
>
>
>
> On Dec 14, 2017, at 3:10 PM, Jared Stehler <jared.stehler@
> intellifylearning.com> wrote:
>
> I see a shaded jackson class with *jackson2* in the package, but none
> with the path shown below.
>
> --
> Jared Stehler
> Chief Architect - Intellify Learning
> o: 617.701.6330 x703 <(617)%20701-6330>
>
>
>
> On Dec 14, 2017, at 3:05 PM, Jared Stehler <jared.stehler@
> intellifylearning.com> wrote:
>
> Getting the following error on app master startup with flink-mesos 1.4.0:
>
> ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>     at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>     at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>     at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
>     at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
>     at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
> ...
> (17 additional frame(s) were not displayed)
>
> NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
>     at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
>     at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
>     at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
>     at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
> ...
> (6 additional frame(s) were not displayed)
>
> ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
> ...
> (10 additional frame(s) were not displayed)
>
>
>
> --
> Jared Stehler
> Chief Architect - Intellify Learning
> o: 617.701.6330 x703 <(617)%20701-6330>
>
>
>
>
>
>

Re: Fenzo NoClassDefFoundError: ObjectMapper

Posted by Jared Stehler <ja...@intellifylearning.com>.
Possibly missing an include for jackson here in the flink-mesos pom?

							<artifactSet>
								<includes combine.children="append">
									<include>com.google.protobuf:protobuf-java</include>
									<include>org.apache.mesos:mesos</include>
									<include>com.netflix.fenzo:fenzo-core</include>
								</includes>
							</artifactSet>
							<relocations combine.children="append">
								<relocation>
									<pattern>com.google.protobuf</pattern>
									<shadedPattern>org.apache.flink.mesos.shaded.com.google.protobuf</shadedPattern>
								</relocation>
								<relocation>
									<pattern>com.fasterxml.jackson</pattern>
									<shadedPattern>org.apache.flink.mesos.shaded.com.fasterxml.jackson</shadedPattern>
								</relocation>
							</relocations>

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



> On Dec 14, 2017, at 3:10 PM, Jared Stehler <ja...@intellifylearning.com> wrote:
> 
> I see a shaded jackson class with jackson2 in the package, but none with the path shown below.
> 
> --
> Jared Stehler
> Chief Architect - Intellify Learning
> o: 617.701.6330 x703
> 
> 
> 
>> On Dec 14, 2017, at 3:05 PM, Jared Stehler <jared.stehler@intellifylearning.com <ma...@intellifylearning.com>> wrote:
>> 
>> Getting the following error on app master startup with flink-mesos 1.4.0:
>> 
>> ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>>     at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>>     at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>>     at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
>>     at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
>>     at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
>> ...
>> (17 additional frame(s) were not displayed)
>> 
>> NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
>>     at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
>>     at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
>>     at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
>>     at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
>> ...
>> (6 additional frame(s) were not displayed)
>> 
>> ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
>> ...
>> (10 additional frame(s) were not displayed)
>> 
>> 
>> --
>> Jared Stehler
>> Chief Architect - Intellify Learning
>> o: 617.701.6330 x703
>> 
>> 
>> 
>

Re: Fenzo NoClassDefFoundError: ObjectMapper

Posted by Jared Stehler <ja...@intellifylearning.com>.
I see a shaded jackson class with jackson2 in the package, but none with the path shown below.

--
Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703



> On Dec 14, 2017, at 3:05 PM, Jared Stehler <ja...@intellifylearning.com> wrote:
> 
> Getting the following error on app master startup with flink-mesos 1.4.0:
> 
> ExecutionException: java.lang.NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>     at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>     at java.util.concurrent.FutureTask.get(FutureTask.java:192)
>     at com.netflix.fenzo.TaskScheduler.doSchedule(TaskScheduler.java:678)
>     at com.netflix.fenzo.TaskScheduler.scheduleOnce(TaskScheduler.java:600)
>     at org.apache.flink.mesos.scheduler.LaunchCoordinator$$anonfun$5.applyOrElse(LaunchCoordinator.scala:173)
> ...
> (17 additional frame(s) were not displayed)
> 
> NoClassDefFoundError: org/apache/flink/mesos/shaded/com/fasterxml/jackson/databind/ObjectMapper
>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
>     at com.netflix.fenzo.AssignableVirtualMachine.findFailedHardConstraints(AssignableVirtualMachine.java:784)
>     at com.netflix.fenzo.AssignableVirtualMachine.tryRequest(AssignableVirtualMachine.java:581)
>     at com.netflix.fenzo.TaskScheduler.evalAssignments(TaskScheduler.java:796)
>     at com.netflix.fenzo.TaskScheduler.access$1500(TaskScheduler.java:70)
> ...
> (6 additional frame(s) were not displayed)
> 
> ClassNotFoundException: org.apache.flink.mesos.shaded.com.fasterxml.jackson.databind.ObjectMapper
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>     at com.netflix.fenzo.ConstraintFailure.<clinit>(ConstraintFailure.java:35)
> ...
> (10 additional frame(s) were not displayed)
> 
> 
> --
> Jared Stehler
> Chief Architect - Intellify Learning
> o: 617.701.6330 x703
> 
> 
>