You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Berges Irani <be...@nextroll.com> on 2019/11/15 19:26:40 UTC
Upgrading to storm 2.0 backtype.tuple.Tuple issue
Hi all,
I'm upgrading to the new version of storm and am running into some issues.
I'll start by providing some background information. I'm running storm from
some docker containers on an ec2 instance. I used this:
https://hub.docker.com/_/storm/ to set up my containers with storm. I then
made copies of my current topologies for an upgrade. I upgraded storm and
the hadoop dependencies in my pom.
The issue I am having is when I run my topology, I get the following error:
Exception in thread "main" java.lang.NoClassDefFoundError:
backtype/storm/tuple/Tuple
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.getDeclaredMethod(Class.java:2128)
at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1629)
at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:79)
at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:520)
at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:494)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:494)
at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:391)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1134)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
at org.apache.storm.utils.Utils.javaSerialize(Utils.java:520)
at org.apache.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:116)
at summarizer2.storm.SummarizerTopology.main(SummarizerTopology.java:213)
Caused by: java.lang.ClassNotFoundException: backtype.storm.tuple.Tuple
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 15 more
As part of the upgrade I went through my codebase and replace
backtype.* with org.apache.storm.*
It is odd to me that backtype is still referenced somehow. My
storm-client on my docker container is 2.0 and so is the one I package
from my pom. I am stumped as to why I get this error, however I am
convinced it has something to do with the storm-client jar on my
docker container. Any ideas?
Thanks,
--
Berges Irani
Engineering Intern
berges.irani@nextroll.com
Re: Upgrading to storm 2.0 backtype.tuple.Tuple issue
Posted by Berges Irani <be...@nextroll.com>.
Not 100% sure what that means. I have storm 2.0 installed on my nimbus
container. It has all the up to date jars. Additionally, the pom I am using
has the 2.0 listed as the dependency. I've repacked using the pom multiple
times. Whats even more odd is I have a second topology that gets packaged
with this one, which runs completely fine.
On Sat, Nov 16, 2019 at 12:16 PM Roshan Naik <ro...@yahoo.com> wrote:
> I suspect you have not recompiled your topologies against 2.0?
>
> Get Outlook for Android <https://aka.ms/ghei36>
>
>
>
>
> On Fri, Nov 15, 2019 at 11:27 AM -0800, "Berges Irani" <
> berges.irani@nextroll.com> wrote:
>
> Hi all,
>>
>> I'm upgrading to the new version of storm and am running into some
>> issues. I'll start by providing some background information. I'm running
>> storm from some docker containers on an ec2 instance. I used this:
>> https://hub.docker.com/_/storm/ to set up my containers with storm. I
>> then made copies of my current topologies for an upgrade. I upgraded storm
>> and the hadoop dependencies in my pom.
>>
>> The issue I am having is when I run my topology, I get the following
>> error:
>>
>> Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/tuple/Tuple
>> at java.lang.Class.getDeclaredMethods0(Native Method)
>> at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
>> at java.lang.Class.getDeclaredMethod(Class.java:2128)
>> at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1629)
>> at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:79)
>> at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:520)
>> at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:494)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:494)
>> at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:391)
>> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1134)
>> at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
>> at org.apache.storm.utils.Utils.javaSerialize(Utils.java:520)
>> at org.apache.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:116)
>> at summarizer2.storm.SummarizerTopology.main(SummarizerTopology.java:213)
>> Caused by: java.lang.ClassNotFoundException: backtype.storm.tuple.Tuple
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> ... 15 more
>>
>>
>> As part of the upgrade I went through my codebase and replace backtype.* with org.apache.storm.*
>>
>> It is odd to me that backtype is still referenced somehow. My storm-client on my docker container is 2.0 and so is the one I package from my pom. I am stumped as to why I get this error, however I am convinced it has something to do with the storm-client jar on my docker container. Any ideas?
>>
>> Thanks,
>>
>>
>> --
>>
>> Berges Irani
>>
>> Engineering Intern
>>
>> berges.irani@nextroll.com
>>
>>
>>
>>
>>
>>
--
Berges Irani
Engineering Intern
berges.irani@nextroll.com
Re: Upgrading to storm 2.0 backtype.tuple.Tuple issue
Posted by Roshan Naik <ro...@yahoo.com>.
I suspect you have not recompiled your topologies against 2.0?
Get Outlook for Android
On Fri, Nov 15, 2019 at 11:27 AM -0800, "Berges Irani" <be...@nextroll.com> wrote:
Hi all,
I'm upgrading to the new version of storm and am running into some issues. I'll start by providing some background information. I'm running storm from some docker containers on an ec2 instance. I used this: https://hub.docker.com/_/storm/ to set up my containers with storm. I then made copies of my current topologies for an upgrade. I upgraded storm and the hadoop dependencies in my pom.
The issue I am having is when I run my topology, I get the following error:Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/tuple/Tuple
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.getDeclaredMethod(Class.java:2128)
at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1629)
at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:79)
at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:520)
at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:494)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:494)
at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:391)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1134)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
at org.apache.storm.utils.Utils.javaSerialize(Utils.java:520)
at org.apache.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:116)
at summarizer2.storm.SummarizerTopology.main(SummarizerTopology.java:213)
Caused by: java.lang.ClassNotFoundException: backtype.storm.tuple.Tuple
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 15 more
As part of the upgrade I went through my codebase and replace backtype.* with org.apache.storm.*It is odd to me that backtype is still referenced somehow. My storm-client on my docker container is 2.0 and so is the one I package from my pom. I am stumped as to why I get this error, however I am convinced it has something to do with the storm-client jar on my docker container. Any ideas?Thanks,
--
Berges Irani
Engineering Intern
berges.irani@nextroll.com