You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by KB <ja...@gmail.com> on 2016/05/03 18:42:42 UTC
Storm 1.0.0 upgrade Serialization issue
Hello,
We have recently upgraded to Storm 1.0.0. Our system was in production for
long with Storm 0.9.
Our topology is not getting loaded with this upgrade. It was working fine
with 0.9.
I am getting following error:
---------------------------------------------------------------------------
119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of server
mk-worker
java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
~[storm-core-1.0.0.jar:1.0.0]
at
org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
~[storm-core-1.0.0.jar:1.0.0]
at
org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
~[storm-core-1.0.0.jar:1.0.0]
at clojure.core$map$fn__4553.invoke(core.clj:2622)
~[clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
at clojure.core$seq__4128.invoke(core.clj:137) ~[clojure-1.7.0.jar:?]
at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
~[clojure-1.7.0.jar:?]
at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
~[clojure-1.7.0.jar:?]
at
clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
~[clojure-1.7.0.jar:?]
at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
~[storm-core-1.0.0.jar:1.0.0]
at
org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
~[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
at clojure.core$next__4112.invoke(core.clj:64) ~[clojure-1.7.0.jar:?]
at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
~[storm-core-1.0.0.jar:1.0.0]
at java.security.AccessController.doPrivileged(Native Method)
~[?:1.8.0_51]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_51]
at
org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
~[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.AFn.applyToHelper(AFn.java:178) ~[clojure-1.7.0.jar:?]
at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.MultiFn.invoke(MultiFn.java:251) [clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.LazySeq.sval(LazySeq.java:40) [clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
at clojure.core$seq__4128.invoke(core.clj:137) [clojure-1.7.0.jar:?]
at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
at
org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
[storm-core-1.0.0.jar:1.0.0]
at
org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
[storm-core-1.0.0.jar:1.0.0]
at clojure.core$partial$fn__4527.invoke(core.clj:2492)
[clojure-1.7.0.jar:?]
at org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
Caused by: java.lang.ClassNotFoundException: boolean
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
~[?:1.8.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_51]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
~[?:1.8.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_51]
----------------------------------------------------------------------------------------------------------------------
It seems some serialization issue with primitives.I appreciate any help to
resolve this issue.
Thanks a ton.
Re: Storm 1.0.0 upgrade Serialization issue
Posted by KB <ja...@gmail.com>.
I appreciate early release but within a month release should be ok with us.
On Thu, May 12, 2016 at 10:37 AM, Jungtaek Lim <ka...@gmail.com> wrote:
> Yeah, I'm also okay with it, since topology not starting for some reason
> is definitely not minor issue. Just feel that we may want to collect bugs
> for some periods.
>
>
> 2016년 5월 12일 (목) 오후 1:13, P. Taylor Goetz <pt...@gmail.com>님이 작성:
>
>> I'm okay with a quick turnaround release for this fix. We've got two
>> valid reports of it, and more will follow quickly as users continue to
>> upgrade.
>>
>> -Taylor
>>
>> On May 11, 2016, at 11:00 PM, Jungtaek Lim <ka...@gmail.com> wrote:
>>
>> KB,
>>
>> Submitted pull request: https://github.com/apache/storm/pull/1412 for 1.x
>>
>> Since Storm 1.0.1 was released at May 6, I feel we may want to gather
>> more bugfixes to prepare next version, and go on release process.
>> But if we think it's critical or even blocker, we could initiate
>> discussion for next release immediately.
>>
>> Hopefully we can release next version within a month.
>>
>> Thanks,
>> Jungtaek Lim (HeartSaVioR)
>>
>> 2016년 5월 11일 (수) 오후 11:34, KB <ja...@gmail.com>님이 작성:
>>
>>> Hi Jungtaek,
>>>
>>> Thanks for providing the snapshot build with this fix. I have verified
>>> the fix and it is working fine.
>>>
>>> Please let me know when can I expect the release with the fix.
>>>
>>> Once again thanks a lot for looking into this.
>>>
>>> On Wed, May 11, 2016 at 8:07 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>>>
>>>> Yes sure, here is storm-core jar 1.0.2 snapshot which just applies
>>>> STORM-1773 patch into Storm 1.0.1.
>>>> http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar
>>>> It just changes the version of common-io from 2.4 to 2.5.
>>>>
>>>> Please let me know if this works so that I can submit pull request.
>>>>
>>>> Thanks in advance!
>>>> Jungtaek Lim (HeartSaVioR)
>>>>
>>>> 2016년 5월 11일 (수) 오전 12:54, KB <ja...@gmail.com>님이 작성:
>>>>
>>>>> Thanks for this update. Actually our topology is built on multiple
>>>>> wrappers on top of Storm. I'll try to create simple topology to reproduce
>>>>> the problem. Meanwhile would it be possible to create a snapshot release
>>>>> with the fix. I'll test and let you know. Please let me know.
>>>>>
>>>>> Regards,
>>>>>
>>>>> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Filed: https://issues.apache.org/jira/browse/STORM-1773
>>>>>>
>>>>>> KB,
>>>>>> could you share sample topology which hits serialization issue? I
>>>>>> would like to check whether patch helps resolving it or not.
>>>>>>
>>>>>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>>>>>>
>>>>>>> Samuel and KB,
>>>>>>>
>>>>>>> I think Storm 1.x hits the bug on commons-io (IO-368
>>>>>>> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>>>>>>>
>>>>>>> Thanks for reporting.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> Jungtaek Lim (HeartSaVioR)
>>>>>>>
>>>>>>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>>>>>>
>>>>>>>> All,
>>>>>>>>
>>>>>>>> This problem persists in release 1.0.1 as well. I appreciate if
>>>>>>>> someone could help fixing this issue.
>>>>>>>>
>>>>>>>> Thanks a lot !!!
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Thanks for your reply Samuel.
>>>>>>>>>
>>>>>>>>> I have setup a very simple topology and not using ObjectMapper or
>>>>>>>>> any other Jackson classes. Although we are using jackson libraries
>>>>>>>>>
>>>>>>>>> Jackson-core-2.6.2
>>>>>>>>>
>>>>>>>>> Jackson-databind-2.4.5
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> and these versions not changed between Storm version 0.9 and
>>>>>>>>> 1.0.0. Please let me know if you make any progress on this issue.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Meanwhile would it help if we raise a jira issue to track the
>>>>>>>>> problem.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Please advice.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> we had a similar issue (see
>>>>>>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>>>>>>>> ). So far, we have not been able to solve it, but we currently have a
>>>>>>>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>>>>>>>> I check whether you also use that?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> With kind regards
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Samuel
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>>>>>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>>>>>>>> *To:* user@storm.apache.org
>>>>>>>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hello,
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in
>>>>>>>>>> production for long with Storm 0.9.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Our topology is not getting loaded with this upgrade. It was
>>>>>>>>>> working fine with 0.9.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I am getting following error:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ---------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization
>>>>>>>>>> of server mk-worker
>>>>>>>>>>
>>>>>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>>>>>>>>> boolean
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$into.invoke(core.clj:6600)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.Cons.next(Cons.java:39)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$dorun.invoke(core.clj:3010)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at java.security.AccessController.doPrivileged(Native
>>>>>>>>>> Method) ~[?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$apply.invoke(core.clj:630)
>>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$dorun.invoke(core.clj:3009)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>>
>>>>>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>>>>>>
>>>>>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>> at
>>>>>>>>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> It seems some serialization issue with primitives.I appreciate
>>>>>>>>>> any help to resolve this issue.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks a ton.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>
>>>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by Jungtaek Lim <ka...@gmail.com>.
Yeah, I'm also okay with it, since topology not starting for some reason is
definitely not minor issue. Just feel that we may want to collect bugs for
some periods.
2016년 5월 12일 (목) 오후 1:13, P. Taylor Goetz <pt...@gmail.com>님이 작성:
> I'm okay with a quick turnaround release for this fix. We've got two valid
> reports of it, and more will follow quickly as users continue to upgrade.
>
> -Taylor
>
> On May 11, 2016, at 11:00 PM, Jungtaek Lim <ka...@gmail.com> wrote:
>
> KB,
>
> Submitted pull request: https://github.com/apache/storm/pull/1412 for 1.x
>
> Since Storm 1.0.1 was released at May 6, I feel we may want to gather more
> bugfixes to prepare next version, and go on release process.
> But if we think it's critical or even blocker, we could initiate
> discussion for next release immediately.
>
> Hopefully we can release next version within a month.
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
> 2016년 5월 11일 (수) 오후 11:34, KB <ja...@gmail.com>님이 작성:
>
>> Hi Jungtaek,
>>
>> Thanks for providing the snapshot build with this fix. I have verified
>> the fix and it is working fine.
>>
>> Please let me know when can I expect the release with the fix.
>>
>> Once again thanks a lot for looking into this.
>>
>> On Wed, May 11, 2016 at 8:07 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>>
>>> Yes sure, here is storm-core jar 1.0.2 snapshot which just applies
>>> STORM-1773 patch into Storm 1.0.1.
>>> http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar
>>> It just changes the version of common-io from 2.4 to 2.5.
>>>
>>> Please let me know if this works so that I can submit pull request.
>>>
>>> Thanks in advance!
>>> Jungtaek Lim (HeartSaVioR)
>>>
>>> 2016년 5월 11일 (수) 오전 12:54, KB <ja...@gmail.com>님이 작성:
>>>
>>>> Thanks for this update. Actually our topology is built on multiple
>>>> wrappers on top of Storm. I'll try to create simple topology to reproduce
>>>> the problem. Meanwhile would it be possible to create a snapshot release
>>>> with the fix. I'll test and let you know. Please let me know.
>>>>
>>>> Regards,
>>>>
>>>> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com>
>>>> wrote:
>>>>
>>>>> Filed: https://issues.apache.org/jira/browse/STORM-1773
>>>>>
>>>>> KB,
>>>>> could you share sample topology which hits serialization issue? I
>>>>> would like to check whether patch helps resolving it or not.
>>>>>
>>>>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>>>>>
>>>>>> Samuel and KB,
>>>>>>
>>>>>> I think Storm 1.x hits the bug on commons-io (IO-368
>>>>>> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>>>>>>
>>>>>> Thanks for reporting.
>>>>>>
>>>>>> Best Regards,
>>>>>> Jungtaek Lim (HeartSaVioR)
>>>>>>
>>>>>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>>>>>
>>>>>>> All,
>>>>>>>
>>>>>>> This problem persists in release 1.0.1 as well. I appreciate if
>>>>>>> someone could help fixing this issue.
>>>>>>>
>>>>>>> Thanks a lot !!!
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Thanks for your reply Samuel.
>>>>>>>>
>>>>>>>> I have setup a very simple topology and not using ObjectMapper or
>>>>>>>> any other Jackson classes. Although we are using jackson libraries
>>>>>>>>
>>>>>>>> Jackson-core-2.6.2
>>>>>>>>
>>>>>>>> Jackson-databind-2.4.5
>>>>>>>>
>>>>>>>>
>>>>>>>> and these versions not changed between Storm version 0.9 and 1.0.0.
>>>>>>>> Please let me know if you make any progress on this issue.
>>>>>>>>
>>>>>>>>
>>>>>>>> Meanwhile would it help if we raise a jira issue to track the
>>>>>>>> problem.
>>>>>>>>
>>>>>>>>
>>>>>>>> Please advice.
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> we had a similar issue (see
>>>>>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>>>>>>> ). So far, we have not been able to solve it, but we currently have a
>>>>>>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>>>>>>> I check whether you also use that?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> With kind regards
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Samuel
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>>>>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>>>>>>> *To:* user@storm.apache.org
>>>>>>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in
>>>>>>>>> production for long with Storm 0.9.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Our topology is not getting loaded with this upgrade. It was
>>>>>>>>> working fine with 0.9.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I am getting following error:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization
>>>>>>>>> of server mk-worker
>>>>>>>>>
>>>>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>>>>>>>> boolean
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$into.invoke(core.clj:6600)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.Cons.next(Cons.java:39)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$dorun.invoke(core.clj:3010)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at java.security.AccessController.doPrivileged(Native
>>>>>>>>> Method) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$apply.invoke(core.clj:630)
>>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$dorun.invoke(core.clj:3009)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at
>>>>>>>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> It seems some serialization issue with primitives.I appreciate any
>>>>>>>>> help to resolve this issue.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks a ton.
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>
>>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by "P. Taylor Goetz" <pt...@gmail.com>.
I'm okay with a quick turnaround release for this fix. We've got two valid reports of it, and more will follow quickly as users continue to upgrade.
-Taylor
> On May 11, 2016, at 11:00 PM, Jungtaek Lim <ka...@gmail.com> wrote:
>
> KB,
>
> Submitted pull request: https://github.com/apache/storm/pull/1412 for 1.x
>
> Since Storm 1.0.1 was released at May 6, I feel we may want to gather more bugfixes to prepare next version, and go on release process.
> But if we think it's critical or even blocker, we could initiate discussion for next release immediately.
>
> Hopefully we can release next version within a month.
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
> 2016년 5월 11일 (수) 오후 11:34, KB <ja...@gmail.com>님이 작성:
>> Hi Jungtaek,
>>
>> Thanks for providing the snapshot build with this fix. I have verified the fix and it is working fine.
>>
>> Please let me know when can I expect the release with the fix.
>>
>> Once again thanks a lot for looking into this.
>>
>>> On Wed, May 11, 2016 at 8:07 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>>> Yes sure, here is storm-core jar 1.0.2 snapshot which just applies STORM-1773 patch into Storm 1.0.1.
>>> http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar
>>> It just changes the version of common-io from 2.4 to 2.5.
>>>
>>> Please let me know if this works so that I can submit pull request.
>>>
>>> Thanks in advance!
>>> Jungtaek Lim (HeartSaVioR)
>>>
>>> 2016년 5월 11일 (수) 오전 12:54, KB <ja...@gmail.com>님이 작성:
>>>> Thanks for this update. Actually our topology is built on multiple wrappers on top of Storm. I'll try to create simple topology to reproduce the problem. Meanwhile would it be possible to create a snapshot release with the fix. I'll test and let you know. Please let me know.
>>>>
>>>> Regards,
>>>>
>>>>> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>>>>> Filed: https://issues.apache.org/jira/browse/STORM-1773
>>>>>
>>>>> KB,
>>>>> could you share sample topology which hits serialization issue? I would like to check whether patch helps resolving it or not.
>>>>>
>>>>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>>>>>> Samuel and KB,
>>>>>>
>>>>>> I think Storm 1.x hits the bug on commons-io (IO-368). I'll file an issue.
>>>>>>
>>>>>> Thanks for reporting.
>>>>>>
>>>>>> Best Regards,
>>>>>> Jungtaek Lim (HeartSaVioR)
>>>>>>
>>>>>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>>>>>> All,
>>>>>>>
>>>>>>> This problem persists in release 1.0.1 as well. I appreciate if someone could help fixing this issue.
>>>>>>>
>>>>>>> Thanks a lot !!!
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>>>>>> Thanks for your reply Samuel.
>>>>>>>>
>>>>>>>> I have setup a very simple topology and not using ObjectMapper or any other Jackson classes. Although we are using jackson libraries
>>>>>>>> Jackson-core-2.6.2
>>>>>>>> Jackson-databind-2.4.5
>>>>>>>>
>>>>>>>> and these versions not changed between Storm version 0.9 and 1.0.0. Please let me know if you make any progress on this issue.
>>>>>>>>
>>>>>>>> Meanwhile would it help if we raise a jira issue to track the problem.
>>>>>>>>
>>>>>>>> Please advice.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>>
>>>>>>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> we had a similar issue (see https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E ). So far, we have not been able to solve it, but we currently have a suspicion that it might be related to the Jackson ObjectMapper we use. Can I check whether you also use that?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> With kind regards
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Samuel
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> From: KB [mailto:jam.developer@gmail.com]
>>>>>>>>> Sent: Dienstag, 3. Mai 2016 18:43
>>>>>>>>> To: user@storm.apache.org
>>>>>>>>> Subject: Storm 1.0.0 upgrade Serialization issue
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in production for long with Storm 0.9.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Our topology is not getting loaded with this upgrade. It was working fine with 0.9.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I am getting following error:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of server mk-worker
>>>>>>>>>
>>>>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>>>>>>>>
>>>>>>>>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$next__4112.invoke(core.clj:64) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606) ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580) [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200) [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380) [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367) [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428) [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40) [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>>
>>>>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>>>>>
>>>>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>>>>>
>>>>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_51]
>>>>>>>>>
>>>>>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> It seems some serialization issue with primitives.I appreciate any help to resolve this issue.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks a ton.
Re: Storm 1.0.0 upgrade Serialization issue
Posted by Jungtaek Lim <ka...@gmail.com>.
KB,
Submitted pull request: https://github.com/apache/storm/pull/1412 for 1.x
Since Storm 1.0.1 was released at May 6, I feel we may want to gather more
bugfixes to prepare next version, and go on release process.
But if we think it's critical or even blocker, we could initiate discussion
for next release immediately.
Hopefully we can release next version within a month.
Thanks,
Jungtaek Lim (HeartSaVioR)
2016년 5월 11일 (수) 오후 11:34, KB <ja...@gmail.com>님이 작성:
> Hi Jungtaek,
>
> Thanks for providing the snapshot build with this fix. I have verified the
> fix and it is working fine.
>
> Please let me know when can I expect the release with the fix.
>
> Once again thanks a lot for looking into this.
>
> On Wed, May 11, 2016 at 8:07 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>
>> Yes sure, here is storm-core jar 1.0.2 snapshot which just applies
>> STORM-1773 patch into Storm 1.0.1.
>> http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar
>> It just changes the version of common-io from 2.4 to 2.5.
>>
>> Please let me know if this works so that I can submit pull request.
>>
>> Thanks in advance!
>> Jungtaek Lim (HeartSaVioR)
>>
>> 2016년 5월 11일 (수) 오전 12:54, KB <ja...@gmail.com>님이 작성:
>>
>>> Thanks for this update. Actually our topology is built on multiple
>>> wrappers on top of Storm. I'll try to create simple topology to reproduce
>>> the problem. Meanwhile would it be possible to create a snapshot release
>>> with the fix. I'll test and let you know. Please let me know.
>>>
>>> Regards,
>>>
>>> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>>>
>>>> Filed: https://issues.apache.org/jira/browse/STORM-1773
>>>>
>>>> KB,
>>>> could you share sample topology which hits serialization issue? I would
>>>> like to check whether patch helps resolving it or not.
>>>>
>>>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>>>>
>>>>> Samuel and KB,
>>>>>
>>>>> I think Storm 1.x hits the bug on commons-io (IO-368
>>>>> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>>>>>
>>>>> Thanks for reporting.
>>>>>
>>>>> Best Regards,
>>>>> Jungtaek Lim (HeartSaVioR)
>>>>>
>>>>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>>>>
>>>>>> All,
>>>>>>
>>>>>> This problem persists in release 1.0.1 as well. I appreciate if
>>>>>> someone could help fixing this issue.
>>>>>>
>>>>>> Thanks a lot !!!
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>>>>
>>>>>>> Thanks for your reply Samuel.
>>>>>>>
>>>>>>> I have setup a very simple topology and not using ObjectMapper or
>>>>>>> any other Jackson classes. Although we are using jackson libraries
>>>>>>>
>>>>>>> Jackson-core-2.6.2
>>>>>>>
>>>>>>> Jackson-databind-2.4.5
>>>>>>>
>>>>>>>
>>>>>>> and these versions not changed between Storm version 0.9 and 1.0.0.
>>>>>>> Please let me know if you make any progress on this issue.
>>>>>>>
>>>>>>>
>>>>>>> Meanwhile would it help if we raise a jira issue to track the
>>>>>>> problem.
>>>>>>>
>>>>>>>
>>>>>>> Please advice.
>>>>>>>
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> we had a similar issue (see
>>>>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>>>>>> ). So far, we have not been able to solve it, but we currently have a
>>>>>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>>>>>> I check whether you also use that?
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> With kind regards
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Samuel
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>>>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>>>>>> *To:* user@storm.apache.org
>>>>>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in
>>>>>>>> production for long with Storm 0.9.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Our topology is not getting loaded with this upgrade. It was
>>>>>>>> working fine with 0.9.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> I am getting following error:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ---------------------------------------------------------------------------
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization
>>>>>>>> of server mk-worker
>>>>>>>>
>>>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>>>>>>> boolean
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$into.invoke(core.clj:6600)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$dorun.invoke(core.clj:3010)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>
>>>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$apply.invoke(core.clj:630)
>>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$dorun.invoke(core.clj:3009)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at
>>>>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>>
>>>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>>>>
>>>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>>>
>>>>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>>>>
>>>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>
>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>
>>>>>>>> at
>>>>>>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
>>>>>>>>
>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>>>>> ~[?:1.8.0_51]
>>>>>>>>
>>>>>>>>
>>>>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> It seems some serialization issue with primitives.I appreciate any
>>>>>>>> help to resolve this issue.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks a ton.
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>
>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by KB <ja...@gmail.com>.
Hi Jungtaek,
Thanks for providing the snapshot build with this fix. I have verified the
fix and it is working fine.
Please let me know when can I expect the release with the fix.
Once again thanks a lot for looking into this.
On Wed, May 11, 2016 at 8:07 AM, Jungtaek Lim <ka...@gmail.com> wrote:
> Yes sure, here is storm-core jar 1.0.2 snapshot which just applies
> STORM-1773 patch into Storm 1.0.1.
> http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar
> It just changes the version of common-io from 2.4 to 2.5.
>
> Please let me know if this works so that I can submit pull request.
>
> Thanks in advance!
> Jungtaek Lim (HeartSaVioR)
>
> 2016년 5월 11일 (수) 오전 12:54, KB <ja...@gmail.com>님이 작성:
>
>> Thanks for this update. Actually our topology is built on multiple
>> wrappers on top of Storm. I'll try to create simple topology to reproduce
>> the problem. Meanwhile would it be possible to create a snapshot release
>> with the fix. I'll test and let you know. Please let me know.
>>
>> Regards,
>>
>> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>>
>>> Filed: https://issues.apache.org/jira/browse/STORM-1773
>>>
>>> KB,
>>> could you share sample topology which hits serialization issue? I would
>>> like to check whether patch helps resolving it or not.
>>>
>>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>>>
>>>> Samuel and KB,
>>>>
>>>> I think Storm 1.x hits the bug on commons-io (IO-368
>>>> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>>>>
>>>> Thanks for reporting.
>>>>
>>>> Best Regards,
>>>> Jungtaek Lim (HeartSaVioR)
>>>>
>>>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>>>
>>>>> All,
>>>>>
>>>>> This problem persists in release 1.0.1 as well. I appreciate if
>>>>> someone could help fixing this issue.
>>>>>
>>>>> Thanks a lot !!!
>>>>>
>>>>>
>>>>>
>>>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>>>
>>>>>> Thanks for your reply Samuel.
>>>>>>
>>>>>> I have setup a very simple topology and not using ObjectMapper or any
>>>>>> other Jackson classes. Although we are using jackson libraries
>>>>>>
>>>>>> Jackson-core-2.6.2
>>>>>>
>>>>>> Jackson-databind-2.4.5
>>>>>>
>>>>>>
>>>>>> and these versions not changed between Storm version 0.9 and 1.0.0.
>>>>>> Please let me know if you make any progress on this issue.
>>>>>>
>>>>>>
>>>>>> Meanwhile would it help if we raise a jira issue to track the problem.
>>>>>>
>>>>>>
>>>>>> Please advice.
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> we had a similar issue (see
>>>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>>>>> ). So far, we have not been able to solve it, but we currently have a
>>>>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>>>>> I check whether you also use that?
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> With kind regards
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Samuel
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>>>>> *To:* user@storm.apache.org
>>>>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in
>>>>>>> production for long with Storm 0.9.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Our topology is not getting loaded with this upgrade. It was working
>>>>>>> fine with 0.9.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> I am getting following error:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------------
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
>>>>>>> server mk-worker
>>>>>>>
>>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$into.invoke(core.clj:6600)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$dorun.invoke(core.clj:3010)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>>> ~[?:1.8.0_51]
>>>>>>>
>>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>>>>> ~[?:1.8.0_51]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$apply.invoke(core.clj:630)
>>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$dorun.invoke(core.clj:3009)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>>>>> [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at
>>>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>>
>>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>>>
>>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>>
>>>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>>>
>>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>>>>> ~[?:1.8.0_51]
>>>>>>>
>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>>>> ~[?:1.8.0_51]
>>>>>>>
>>>>>>> at
>>>>>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
>>>>>>>
>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>>>> ~[?:1.8.0_51]
>>>>>>>
>>>>>>>
>>>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> It seems some serialization issue with primitives.I appreciate any
>>>>>>> help to resolve this issue.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Thanks a ton.
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by Jungtaek Lim <ka...@gmail.com>.
Yes sure, here is storm-core jar 1.0.2 snapshot which just applies
STORM-1773 patch into Storm 1.0.1.
http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar
It just changes the version of common-io from 2.4 to 2.5.
Please let me know if this works so that I can submit pull request.
Thanks in advance!
Jungtaek Lim (HeartSaVioR)
2016년 5월 11일 (수) 오전 12:54, KB <ja...@gmail.com>님이 작성:
> Thanks for this update. Actually our topology is built on multiple
> wrappers on top of Storm. I'll try to create simple topology to reproduce
> the problem. Meanwhile would it be possible to create a snapshot release
> with the fix. I'll test and let you know. Please let me know.
>
> Regards,
>
> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com> wrote:
>
>> Filed: https://issues.apache.org/jira/browse/STORM-1773
>>
>> KB,
>> could you share sample topology which hits serialization issue? I would
>> like to check whether patch helps resolving it or not.
>>
>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>>
>>> Samuel and KB,
>>>
>>> I think Storm 1.x hits the bug on commons-io (IO-368
>>> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>>>
>>> Thanks for reporting.
>>>
>>> Best Regards,
>>> Jungtaek Lim (HeartSaVioR)
>>>
>>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>>
>>>> All,
>>>>
>>>> This problem persists in release 1.0.1 as well. I appreciate if someone
>>>> could help fixing this issue.
>>>>
>>>> Thanks a lot !!!
>>>>
>>>>
>>>>
>>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>>
>>>>> Thanks for your reply Samuel.
>>>>>
>>>>> I have setup a very simple topology and not using ObjectMapper or any
>>>>> other Jackson classes. Although we are using jackson libraries
>>>>>
>>>>> Jackson-core-2.6.2
>>>>>
>>>>> Jackson-databind-2.4.5
>>>>>
>>>>>
>>>>> and these versions not changed between Storm version 0.9 and 1.0.0.
>>>>> Please let me know if you make any progress on this issue.
>>>>>
>>>>>
>>>>> Meanwhile would it help if we raise a jira issue to track the problem.
>>>>>
>>>>>
>>>>> Please advice.
>>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>>
>>>>>
>>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> we had a similar issue (see
>>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>>>> ). So far, we have not been able to solve it, but we currently have a
>>>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>>>> I check whether you also use that?
>>>>>>
>>>>>>
>>>>>>
>>>>>> With kind regards
>>>>>>
>>>>>>
>>>>>>
>>>>>> Samuel
>>>>>>
>>>>>>
>>>>>>
>>>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>>>> *To:* user@storm.apache.org
>>>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>>>
>>>>>>
>>>>>>
>>>>>> Hello,
>>>>>>
>>>>>>
>>>>>>
>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in
>>>>>> production for long with Storm 0.9.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Our topology is not getting loaded with this upgrade. It was working
>>>>>> fine with 0.9.
>>>>>>
>>>>>>
>>>>>>
>>>>>> I am getting following error:
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------------
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
>>>>>> server mk-worker
>>>>>>
>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>>>>>
>>>>>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$into.invoke(core.clj:6600)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$dorun.invoke(core.clj:3010)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>> ~[?:1.8.0_51]
>>>>>>
>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>>>> ~[?:1.8.0_51]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$apply.invoke(core.clj:630)
>>>>>> ~[clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$dorun.invoke(core.clj:3009)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>>>> [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at
>>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>>
>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>>
>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>
>>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>>
>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>>>> ~[?:1.8.0_51]
>>>>>>
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>>> ~[?:1.8.0_51]
>>>>>>
>>>>>> at
>>>>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
>>>>>>
>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>>> ~[?:1.8.0_51]
>>>>>>
>>>>>>
>>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> It seems some serialization issue with primitives.I appreciate any
>>>>>> help to resolve this issue.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks a ton.
>>>>>>
>>>>>
>>>>>
>>>>
>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by KB <ja...@gmail.com>.
Thanks for this update. Actually our topology is built on multiple wrappers
on top of Storm. I'll try to create simple topology to reproduce the
problem. Meanwhile would it be possible to create a snapshot release with
the fix. I'll test and let you know. Please let me know.
Regards,
On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <ka...@gmail.com> wrote:
> Filed: https://issues.apache.org/jira/browse/STORM-1773
>
> KB,
> could you share sample topology which hits serialization issue? I would
> like to check whether patch helps resolving it or not.
>
> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
>
>> Samuel and KB,
>>
>> I think Storm 1.x hits the bug on commons-io (IO-368
>> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>>
>> Thanks for reporting.
>>
>> Best Regards,
>> Jungtaek Lim (HeartSaVioR)
>>
>> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>>
>>> All,
>>>
>>> This problem persists in release 1.0.1 as well. I appreciate if someone
>>> could help fixing this issue.
>>>
>>> Thanks a lot !!!
>>>
>>>
>>>
>>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>>
>>>> Thanks for your reply Samuel.
>>>>
>>>> I have setup a very simple topology and not using ObjectMapper or any
>>>> other Jackson classes. Although we are using jackson libraries
>>>>
>>>> Jackson-core-2.6.2
>>>>
>>>> Jackson-databind-2.4.5
>>>>
>>>>
>>>> and these versions not changed between Storm version 0.9 and 1.0.0.
>>>> Please let me know if you make any progress on this issue.
>>>>
>>>>
>>>> Meanwhile would it help if we raise a jira issue to track the problem.
>>>>
>>>>
>>>> Please advice.
>>>>
>>>>
>>>> Thanks,
>>>>
>>>>
>>>>
>>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> we had a similar issue (see
>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>>> ). So far, we have not been able to solve it, but we currently have a
>>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>>> I check whether you also use that?
>>>>>
>>>>>
>>>>>
>>>>> With kind regards
>>>>>
>>>>>
>>>>>
>>>>> Samuel
>>>>>
>>>>>
>>>>>
>>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>>> *To:* user@storm.apache.org
>>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>>
>>>>>
>>>>>
>>>>> Hello,
>>>>>
>>>>>
>>>>>
>>>>> We have recently upgraded to Storm 1.0.0. Our system was in production
>>>>> for long with Storm 0.9.
>>>>>
>>>>>
>>>>>
>>>>> Our topology is not getting loaded with this upgrade. It was working
>>>>> fine with 0.9.
>>>>>
>>>>>
>>>>>
>>>>> I am getting following error:
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------------
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
>>>>> server mk-worker
>>>>>
>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>>>>
>>>>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$dorun.invoke(core.clj:3010)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$doall.invoke(core.clj:3025)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>> ~[?:1.8.0_51]
>>>>>
>>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>>> ~[?:1.8.0_51]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>>> ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>>> [clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>>> [clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>>> [clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>>> [clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>>> [clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
>>>>>
>>>>> at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at
>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>>> [clojure-1.7.0.jar:?]
>>>>>
>>>>> at
>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>>
>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>>
>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>
>>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>>
>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>>> ~[?:1.8.0_51]
>>>>>
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>>> ~[?:1.8.0_51]
>>>>>
>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>>>>> ~[?:1.8.0_51]
>>>>>
>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>>> ~[?:1.8.0_51]
>>>>>
>>>>>
>>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> It seems some serialization issue with primitives.I appreciate any
>>>>> help to resolve this issue.
>>>>>
>>>>>
>>>>>
>>>>> Thanks a ton.
>>>>>
>>>>
>>>>
>>>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by Jungtaek Lim <ka...@gmail.com>.
Filed: https://issues.apache.org/jira/browse/STORM-1773
KB,
could you share sample topology which hits serialization issue? I would
like to check whether patch helps resolving it or not.
2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <ka...@gmail.com>님이 작성:
> Samuel and KB,
>
> I think Storm 1.x hits the bug on commons-io (IO-368
> <https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
>
> Thanks for reporting.
>
> Best Regards,
> Jungtaek Lim (HeartSaVioR)
>
> 2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
>
>> All,
>>
>> This problem persists in release 1.0.1 as well. I appreciate if someone
>> could help fixing this issue.
>>
>> Thanks a lot !!!
>>
>>
>>
>> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>>
>>> Thanks for your reply Samuel.
>>>
>>> I have setup a very simple topology and not using ObjectMapper or any
>>> other Jackson classes. Although we are using jackson libraries
>>>
>>> Jackson-core-2.6.2
>>>
>>> Jackson-databind-2.4.5
>>>
>>>
>>> and these versions not changed between Storm version 0.9 and 1.0.0.
>>> Please let me know if you make any progress on this issue.
>>>
>>>
>>> Meanwhile would it help if we raise a jira issue to track the problem.
>>>
>>>
>>> Please advice.
>>>
>>>
>>> Thanks,
>>>
>>>
>>>
>>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> we had a similar issue (see
>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>>> ). So far, we have not been able to solve it, but we currently have a
>>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>>> I check whether you also use that?
>>>>
>>>>
>>>>
>>>> With kind regards
>>>>
>>>>
>>>>
>>>> Samuel
>>>>
>>>>
>>>>
>>>> *From:* KB [mailto:jam.developer@gmail.com]
>>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>>> *To:* user@storm.apache.org
>>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>>
>>>>
>>>>
>>>> Hello,
>>>>
>>>>
>>>>
>>>> We have recently upgraded to Storm 1.0.0. Our system was in production
>>>> for long with Storm 0.9.
>>>>
>>>>
>>>>
>>>> Our topology is not getting loaded with this upgrade. It was working
>>>> fine with 0.9.
>>>>
>>>>
>>>>
>>>> I am getting following error:
>>>>
>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------------
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
>>>> server mk-worker
>>>>
>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>>>
>>>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at
>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at
>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at
>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at
>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$reduce.invoke(core.clj:6519)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at
>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$next__4112.invoke(core.clj:64)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>> ~[?:1.8.0_51]
>>>>
>>>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>>> ~[?:1.8.0_51]
>>>>
>>>> at
>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>>> ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>>> [clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>>> [clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>>> [clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>>> [clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
>>>>
>>>> at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at
>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>>> [clojure-1.7.0.jar:?]
>>>>
>>>> at
>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>>> [storm-core-1.0.0.jar:1.0.0]
>>>>
>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>>
>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>
>>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>>
>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>>> ~[?:1.8.0_51]
>>>>
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>> ~[?:1.8.0_51]
>>>>
>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>>>> ~[?:1.8.0_51]
>>>>
>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>> ~[?:1.8.0_51]
>>>>
>>>>
>>>> ----------------------------------------------------------------------------------------------------------------------
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> It seems some serialization issue with primitives.I appreciate any help
>>>> to resolve this issue.
>>>>
>>>>
>>>>
>>>> Thanks a ton.
>>>>
>>>
>>>
>>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by Jungtaek Lim <ka...@gmail.com>.
Samuel and KB,
I think Storm 1.x hits the bug on commons-io (IO-368
<https://issues.apache.org/jira/browse/IO-368>). I'll file an issue.
Thanks for reporting.
Best Regards,
Jungtaek Lim (HeartSaVioR)
2016년 5월 10일 (화) 오전 1:33, KB <ja...@gmail.com>님이 작성:
> All,
>
> This problem persists in release 1.0.1 as well. I appreciate if someone
> could help fixing this issue.
>
> Thanks a lot !!!
>
>
>
> On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
>
>> Thanks for your reply Samuel.
>>
>> I have setup a very simple topology and not using ObjectMapper or any
>> other Jackson classes. Although we are using jackson libraries
>>
>> Jackson-core-2.6.2
>>
>> Jackson-databind-2.4.5
>>
>>
>> and these versions not changed between Storm version 0.9 and 1.0.0.
>> Please let me know if you make any progress on this issue.
>>
>>
>> Meanwhile would it help if we raise a jira issue to track the problem.
>>
>>
>> Please advice.
>>
>>
>> Thanks,
>>
>>
>>
>> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>>
>>> Hi,
>>>
>>> we had a similar issue (see
>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>>> ). So far, we have not been able to solve it, but we currently have a
>>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>>> I check whether you also use that?
>>>
>>>
>>>
>>> With kind regards
>>>
>>>
>>>
>>> Samuel
>>>
>>>
>>>
>>> *From:* KB [mailto:jam.developer@gmail.com]
>>> *Sent:* Dienstag, 3. Mai 2016 18:43
>>> *To:* user@storm.apache.org
>>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> We have recently upgraded to Storm 1.0.0. Our system was in production
>>> for long with Storm 0.9.
>>>
>>>
>>>
>>> Our topology is not getting loaded with this upgrade. It was working
>>> fine with 0.9.
>>>
>>>
>>>
>>> I am getting following error:
>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------------
>>>
>>>
>>>
>>>
>>>
>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
>>> server mk-worker
>>>
>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>>
>>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at
>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at
>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at
>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at
>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at
>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at
>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.lang.LazySeq.sval(LazySeq.java:40)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$next__4112.invoke(core.clj:64)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> ~[?:1.8.0_51]
>>>
>>> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_51]
>>>
>>> at
>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>>> ~[storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>>> ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>>> [storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.lang.RestFn.invoke(RestFn.java:512)
>>> [clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>>> [storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>>> [clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>>> [storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) [clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
>>>
>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$seq__4128.invoke(core.clj:137)
>>> [clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
>>>
>>> at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>>> [storm-core-1.0.0.jar:1.0.0]
>>>
>>> at
>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>>> [storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>>> [clojure-1.7.0.jar:?]
>>>
>>> at
>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>>> [storm-core-1.0.0.jar:1.0.0]
>>>
>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>>
>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>
>>> Caused by: java.lang.ClassNotFoundException: boolean
>>>
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>>> ~[?:1.8.0_51]
>>>
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>> ~[?:1.8.0_51]
>>>
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>>> ~[?:1.8.0_51]
>>>
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>> ~[?:1.8.0_51]
>>>
>>>
>>> ----------------------------------------------------------------------------------------------------------------------
>>>
>>>
>>>
>>>
>>>
>>> It seems some serialization issue with primitives.I appreciate any help
>>> to resolve this issue.
>>>
>>>
>>>
>>> Thanks a ton.
>>>
>>
>>
>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by KB <ja...@gmail.com>.
All,
This problem persists in release 1.0.1 as well. I appreciate if someone
could help fixing this issue.
Thanks a lot !!!
On Wed, May 4, 2016 at 7:41 PM, KB <ja...@gmail.com> wrote:
> Thanks for your reply Samuel.
>
> I have setup a very simple topology and not using ObjectMapper or any
> other Jackson classes. Although we are using jackson libraries
>
> Jackson-core-2.6.2
>
> Jackson-databind-2.4.5
>
>
> and these versions not changed between Storm version 0.9 and 1.0.0. Please
> let me know if you make any progress on this issue.
>
>
> Meanwhile would it help if we raise a jira issue to track the problem.
>
>
> Please advice.
>
>
> Thanks,
>
>
>
> On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
>
>> Hi,
>>
>> we had a similar issue (see
>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
>> ). So far, we have not been able to solve it, but we currently have a
>> suspicion that it might be related to the Jackson ObjectMapper we use. Can
>> I check whether you also use that?
>>
>>
>>
>> With kind regards
>>
>>
>>
>> Samuel
>>
>>
>>
>> *From:* KB [mailto:jam.developer@gmail.com]
>> *Sent:* Dienstag, 3. Mai 2016 18:43
>> *To:* user@storm.apache.org
>> *Subject:* Storm 1.0.0 upgrade Serialization issue
>>
>>
>>
>> Hello,
>>
>>
>>
>> We have recently upgraded to Storm 1.0.0. Our system was in production
>> for long with Storm 0.9.
>>
>>
>>
>> Our topology is not getting loaded with this upgrade. It was working fine
>> with 0.9.
>>
>>
>>
>> I am getting following error:
>>
>>
>>
>>
>> ---------------------------------------------------------------------------
>>
>>
>>
>>
>>
>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
>> server mk-worker
>>
>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>>
>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at
>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at
>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at
>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.core$map$fn__4553.invoke(core.clj:2622)
>> ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$seq__4128.invoke(core.clj:137)
>> ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
>> ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
>> ~[clojure-1.7.0.jar:?]
>>
>> at
>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
>> ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at
>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$next__4112.invoke(core.clj:64)
>> ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at java.security.AccessController.doPrivileged(Native Method)
>> ~[?:1.8.0_51]
>>
>> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_51]
>>
>> at
>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
>> ~[storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.lang.AFn.applyToHelper(AFn.java:178)
>> ~[clojure-1.7.0.jar:?]
>>
>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>>
>> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
>> [storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
>> [storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
>> [clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
>> [storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.lang.LazySeq.sval(LazySeq.java:40) [clojure-1.7.0.jar:?]
>>
>> at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
>>
>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>>
>> at clojure.core$seq__4128.invoke(core.clj:137) [clojure-1.7.0.jar:?]
>>
>> at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
>>
>> at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
>> [storm-core-1.0.0.jar:1.0.0]
>>
>> at
>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
>> [storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
>> [clojure-1.7.0.jar:?]
>>
>> at
>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
>> [storm-core-1.0.0.jar:1.0.0]
>>
>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>>
>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>
>> Caused by: java.lang.ClassNotFoundException: boolean
>>
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>> ~[?:1.8.0_51]
>>
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> ~[?:1.8.0_51]
>>
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>> ~[?:1.8.0_51]
>>
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> ~[?:1.8.0_51]
>>
>>
>> ----------------------------------------------------------------------------------------------------------------------
>>
>>
>>
>>
>>
>> It seems some serialization issue with primitives.I appreciate any help
>> to resolve this issue.
>>
>>
>>
>> Thanks a ton.
>>
>
>
Re: Storm 1.0.0 upgrade Serialization issue
Posted by KB <ja...@gmail.com>.
Thanks for your reply Samuel.
I have setup a very simple topology and not using ObjectMapper or any other
Jackson classes. Although we are using jackson libraries
Jackson-core-2.6.2
Jackson-databind-2.4.5
and these versions not changed between Storm version 0.9 and 1.0.0. Please
let me know if you make any progress on this issue.
Meanwhile would it help if we raise a jira issue to track the problem.
Please advice.
Thanks,
On Tue, May 3, 2016 at 10:17 PM, <Sa...@swisscom.com> wrote:
> Hi,
>
> we had a similar issue (see
> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E
> ). So far, we have not been able to solve it, but we currently have a
> suspicion that it might be related to the Jackson ObjectMapper we use. Can
> I check whether you also use that?
>
>
>
> With kind regards
>
>
>
> Samuel
>
>
>
> *From:* KB [mailto:jam.developer@gmail.com]
> *Sent:* Dienstag, 3. Mai 2016 18:43
> *To:* user@storm.apache.org
> *Subject:* Storm 1.0.0 upgrade Serialization issue
>
>
>
> Hello,
>
>
>
> We have recently upgraded to Storm 1.0.0. Our system was in production for
> long with Storm 0.9.
>
>
>
> Our topology is not getting loaded with this upgrade. It was working fine
> with 0.9.
>
>
>
> I am getting following error:
>
>
>
> ---------------------------------------------------------------------------
>
>
>
>
>
> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of
> server mk-worker
>
> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
>
> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at
> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at
> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at
> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at clojure.core$map$fn__4553.invoke(core.clj:2622)
> ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
>
> at clojure.core$seq__4128.invoke(core.clj:137) ~[clojure-1.7.0.jar:?]
>
> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)
> ~[clojure-1.7.0.jar:?]
>
> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101)
> ~[clojure-1.7.0.jar:?]
>
> at
> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13)
> ~[clojure-1.7.0.jar:?]
>
> at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
>
> at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at
> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
>
> at clojure.core$next__4112.invoke(core.clj:64) ~[clojure-1.7.0.jar:?]
>
> at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
>
> at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_51]
>
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_51]
>
> at
> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606)
> ~[storm-core-1.0.0.jar:1.0.0]
>
> at clojure.lang.AFn.applyToHelper(AFn.java:178)
> ~[clojure-1.7.0.jar:?]
>
> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
>
> at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580)
> [storm-core-1.0.0.jar:1.0.0]
>
> at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200)
> [storm-core-1.0.0.jar:1.0.0]
>
> at clojure.lang.MultiFn.invoke(MultiFn.java:251)
> [clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380)
> [storm-core-1.0.0.jar:1.0.0]
>
> at clojure.lang.LazySeq.sval(LazySeq.java:40) [clojure-1.7.0.jar:?]
>
> at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
>
> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
>
> at clojure.core$seq__4128.invoke(core.clj:137) [clojure-1.7.0.jar:?]
>
> at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
>
> at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367)
> [storm-core-1.0.0.jar:1.0.0]
>
> at
> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428)
> [storm-core-1.0.0.jar:1.0.0]
>
> at clojure.core$partial$fn__4527.invoke(core.clj:2492)
> [clojure-1.7.0.jar:?]
>
> at
> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40)
> [storm-core-1.0.0.jar:1.0.0]
>
> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
>
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>
> Caused by: java.lang.ClassNotFoundException: boolean
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> ~[?:1.8.0_51]
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> ~[?:1.8.0_51]
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> ~[?:1.8.0_51]
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ~[?:1.8.0_51]
>
>
> ----------------------------------------------------------------------------------------------------------------------
>
>
>
>
>
> It seems some serialization issue with primitives.I appreciate any help to
> resolve this issue.
>
>
>
> Thanks a ton.
>
RE: Storm 1.0.0 upgrade Serialization issue
Posted by Sa...@swisscom.com.
Hi,
we had a similar issue (see https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E ). So far, we have not been able to solve it, but we currently have a suspicion that it might be related to the Jackson ObjectMapper we use. Can I check whether you also use that?
With kind regards
Samuel
From: KB [mailto:jam.developer@gmail.com]
Sent: Dienstag, 3. Mai 2016 18:43
To: user@storm.apache.org
Subject: Storm 1.0.0 upgrade Serialization issue
Hello,
We have recently upgraded to Storm 1.0.0. Our system was in production for long with Storm 0.9.
Our topology is not getting loaded with this upgrade. It was working fine with 0.9.
I am getting following error:
---------------------------------------------------------------------------
119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of server mk-worker
java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean
at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371) ~[storm-core-1.0.0.jar:1.0.0]
at clojure.core$map$fn__4553.invoke(core.clj:2622) ~[clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?]
at clojure.core$seq__4128.invoke(core.clj:137) ~[clojure-1.7.0.jar:?]
at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30) ~[clojure-1.7.0.jar:?]
at clojure.core.protocols$fn__6506.invoke(protocols.clj:101) ~[clojure-1.7.0.jar:?]
at clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13) ~[clojure-1.7.0.jar:?]
at clojure.core$reduce.invoke(core.clj:6519) ~[clojure-1.7.0.jar:?]
at clojure.core$into.invoke(core.clj:6600) ~[clojure-1.7.0.jar:?]
at org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372) ~[storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634) ~[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.LazySeq.sval(LazySeq.java:40) ~[clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.seq(LazySeq.java:49) ~[clojure-1.7.0.jar:?]
at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?]
at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?]
at clojure.core$next__4112.invoke(core.clj:64) ~[clojure-1.7.0.jar:?]
at clojure.core$dorun.invoke(core.clj:3010) ~[clojure-1.7.0.jar:?]
at clojure.core$doall.invoke(core.clj:3025) ~[clojure-1.7.0.jar:?]
at org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634) ~[storm-core-1.0.0.jar:1.0.0]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_51]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_51]
at org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606) ~[storm-core-1.0.0.jar:1.0.0]
at clojure.lang.AFn.applyToHelper(AFn.java:178) ~[clojure-1.7.0.jar:?]
at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?]
at clojure.core$apply.invoke(core.clj:630) ~[clojure-1.7.0.jar:?]
at org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580) [storm-core-1.0.0.jar:1.0.0]
at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0.jar:?]
at org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200) [storm-core-1.0.0.jar:1.0.0]
at clojure.lang.MultiFn.invoke(MultiFn.java:251) [clojure-1.7.0.jar:?]
at org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380) [storm-core-1.0.0.jar:1.0.0]
at clojure.lang.LazySeq.sval(LazySeq.java:40) [clojure-1.7.0.jar:?]
at clojure.lang.LazySeq.seq(LazySeq.java:49) [clojure-1.7.0.jar:?]
at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?]
at clojure.core$seq__4128.invoke(core.clj:137) [clojure-1.7.0.jar:?]
at clojure.core$dorun.invoke(core.clj:3009) [clojure-1.7.0.jar:?]
at clojure.core$doall.invoke(core.clj:3025) [clojure-1.7.0.jar:?]
at org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367) [storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428) [storm-core-1.0.0.jar:1.0.0]
at clojure.core$partial$fn__4527.invoke(core.clj:2492) [clojure-1.7.0.jar:?]
at org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40) [storm-core-1.0.0.jar:1.0.0]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
Caused by: java.lang.ClassNotFoundException: boolean
at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[?:1.8.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_51]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[?:1.8.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_51]
----------------------------------------------------------------------------------------------------------------------
It seems some serialization issue with primitives.I appreciate any help to resolve this issue.
Thanks a ton.