You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by Jungtaek Lim <ka...@gmail.com> on 2018/01/01 22:47:00 UTC
Re: Ask for review on Storm 2.0.0 items
Alexandre,
The origin plan for Storm 2.0.0 was merging JStorm as you've said, but the
progress was slow while porting Clojure code to Java, and Alibaba
developers got back to their JStorm development. So we have tasks to port
Clojure to Java which is what Storm community itself wants, but no more. We
filed issues introducing JStorm's features but unfortunately no one is
working on that.
Instead, we are shipping our own improvements in Storm 2.0.0. Here's short
summary to Storm 2.0.0 so please refer the link if you didn't see it.
https://mail-archives.apache.org/mod_mbox/storm-user/201712.mbox/%3CCAF5108j0iGxH7QdZKz81uxCTykQZZfNwpagEV_hYYhT8xmxYUg%40mail.gmail.com%3E
Thanks,
Jungtaek Lim (HeartSaVioR)
2017년 12월 31일 (일) 오전 11:42, Satish Duggana <sa...@gmail.com>님이 작성:
> Hi Alexendre,
> Event time windowing is already supported in Storm, you can go through
> http://storm.apache.org/releases/2.0.0-SNAPSHOT/Windowing.html here.
>
> Thanks,
> Satish.
>
> On Sat, Dec 30, 2017 at 3:24 PM, Alexandre Vermeerbergen <
> avermeerbergen@gmail.com> wrote:
>
> > Hello,
> >
> > Unless I am mistaking, one of the Storm 2's targets includes a
> convergence
> > with JStorm.
> > JStorm seems to have neat window-processing features and it is part of
> > Apache Beam ecosystem, see:
> > https://beam.apache.org/documentation/runners/capability-matrix/
> >
> > Will Storm 2.0.0 include JStorm windows processing features (in
> particular,
> > "event time"-based ones?)
> > Will it have its Beam Runner?
> >
> > Also for Storm 2.0.0 : is there a plan to officially support Java 9, as
> > ORACLE Java 8 is planned to reach end of public support by September 2018
> > (see http://www.oracle.com/technetwork/java/eol-135779.html) ? (FYI
> Kafka
> > 1.0.0 has official Java 9 support)
> >
> > Best regards,
> > Alexandre Vermeerbergen
> >
> >
> > 2017-12-30 1:08 GMT+01:00 Jungtaek Lim <ka...@gmail.com>:
> >
> > > Hi devs,
> > >
> > > First of all, happy new year!
> > > I'd like to ask for help on reviewing Storm 2.0.0 items, so that we
> could
> > > get closer on releasing Storm 2.0.0 (early, I hope) next year.
> > >
> > > STORM-2306 : Messaging subsystem redesign
> > > https://github.com/apache/storm/pull/2241
> > >
> > > STORM-2693: Heartbeats and assignments promotion
> > > https://github.com/apache/storm/pull/2433
> > >
> > > Please enumerate issues if you have any.
> > >
> > > Below is the item for 1.2.0, but if in case it can't be included in
> > 1.2.0.
> > >
> > > STORM-2153: New Metrics Reporting API
> > > https://github.com/apache/storm/pull/2203
> > >
> > > Thanks,
> > > Jungtaek Lim (HeartSaVioR)
> > >
> >
>
Re: Ask for review on Storm 2.0.0 items
Posted by Jungtaek Lim <ka...@gmail.com>.
Yes, with one correction: windowed processing has been already existed on
Storm 1.0.0, so that's not a new feature.
http://storm.apache.org/releases/1.1.1/Windowing.html
- Jungtaek Lim (HeartSaVioR)
2018년 1월 2일 (화) 오후 8:27, Alexandre Vermeerbergen <av...@gmail.com>님이
작성:
> Hello All,
>
> Thank you very much for your answers.
>
> To sum up, here's my understanding of Storm 2.0.0 upcoming features related
> to my questions:
>
> * Even if Storm 2.0.0 won't be the same as JStorm, we're going to have at
> least:
> - a rewrite of existing Closure source in Java
> - not exactly a Beam Runner, but a streaming API anyway, which
> event-time processing features
> * Storm 2.0.0 will have Java 9 Run-time support except for Hive & Cassandra
> extensions
>
> Is it correct?
>
> Best regards,
> Alexandre Vermeerbergen
>
>
>
>
>
> 2018-01-01 23:47 GMT+01:00 Jungtaek Lim <ka...@gmail.com>:
>
> > Alexandre,
> >
> > The origin plan for Storm 2.0.0 was merging JStorm as you've said, but
> the
> > progress was slow while porting Clojure code to Java, and Alibaba
> > developers got back to their JStorm development. So we have tasks to port
> > Clojure to Java which is what Storm community itself wants, but no more.
> We
> > filed issues introducing JStorm's features but unfortunately no one is
> > working on that.
> >
> > Instead, we are shipping our own improvements in Storm 2.0.0. Here's
> short
> > summary to Storm 2.0.0 so please refer the link if you didn't see it.
> >
> > https://mail-archives.apache.org/mod_mbox/storm-user/201712.mbox/%
> > 3CCAF5108j0iGxH7QdZKz81uxCTykQZZfNwpagEV_hYYhT8xmxYUg%40mail.gmail.com
> %3E
> >
> > Thanks,
> > Jungtaek Lim (HeartSaVioR)
> >
> > 2017년 12월 31일 (일) 오전 11:42, Satish Duggana <sa...@gmail.com>님이
> > 작성:
> >
> > > Hi Alexendre,
> > > Event time windowing is already supported in Storm, you can go through
> > > http://storm.apache.org/releases/2.0.0-SNAPSHOT/Windowing.html here.
> > >
> > > Thanks,
> > > Satish.
> > >
> > > On Sat, Dec 30, 2017 at 3:24 PM, Alexandre Vermeerbergen <
> > > avermeerbergen@gmail.com> wrote:
> > >
> > > > Hello,
> > > >
> > > > Unless I am mistaking, one of the Storm 2's targets includes a
> > > convergence
> > > > with JStorm.
> > > > JStorm seems to have neat window-processing features and it is part
> of
> > > > Apache Beam ecosystem, see:
> > > > https://beam.apache.org/documentation/runners/capability-matrix/
> > > >
> > > > Will Storm 2.0.0 include JStorm windows processing features (in
> > > particular,
> > > > "event time"-based ones?)
> > > > Will it have its Beam Runner?
> > > >
> > > > Also for Storm 2.0.0 : is there a plan to officially support Java 9,
> as
> > > > ORACLE Java 8 is planned to reach end of public support by September
> > 2018
> > > > (see http://www.oracle.com/technetwork/java/eol-135779.html) ? (FYI
> > > Kafka
> > > > 1.0.0 has official Java 9 support)
> > > >
> > > > Best regards,
> > > > Alexandre Vermeerbergen
> > > >
> > > >
> > > > 2017-12-30 1:08 GMT+01:00 Jungtaek Lim <ka...@gmail.com>:
> > > >
> > > > > Hi devs,
> > > > >
> > > > > First of all, happy new year!
> > > > > I'd like to ask for help on reviewing Storm 2.0.0 items, so that we
> > > could
> > > > > get closer on releasing Storm 2.0.0 (early, I hope) next year.
> > > > >
> > > > > STORM-2306 : Messaging subsystem redesign
> > > > > https://github.com/apache/storm/pull/2241
> > > > >
> > > > > STORM-2693: Heartbeats and assignments promotion
> > > > > https://github.com/apache/storm/pull/2433
> > > > >
> > > > > Please enumerate issues if you have any.
> > > > >
> > > > > Below is the item for 1.2.0, but if in case it can't be included in
> > > > 1.2.0.
> > > > >
> > > > > STORM-2153: New Metrics Reporting API
> > > > > https://github.com/apache/storm/pull/2203
> > > > >
> > > > > Thanks,
> > > > > Jungtaek Lim (HeartSaVioR)
> > > > >
> > > >
> > >
> >
>
Re: Ask for review on Storm 2.0.0 items
Posted by Alexandre Vermeerbergen <av...@gmail.com>.
Hello All,
Thank you very much for your answers.
To sum up, here's my understanding of Storm 2.0.0 upcoming features related
to my questions:
* Even if Storm 2.0.0 won't be the same as JStorm, we're going to have at
least:
- a rewrite of existing Closure source in Java
- not exactly a Beam Runner, but a streaming API anyway, which
event-time processing features
* Storm 2.0.0 will have Java 9 Run-time support except for Hive & Cassandra
extensions
Is it correct?
Best regards,
Alexandre Vermeerbergen
2018-01-01 23:47 GMT+01:00 Jungtaek Lim <ka...@gmail.com>:
> Alexandre,
>
> The origin plan for Storm 2.0.0 was merging JStorm as you've said, but the
> progress was slow while porting Clojure code to Java, and Alibaba
> developers got back to their JStorm development. So we have tasks to port
> Clojure to Java which is what Storm community itself wants, but no more. We
> filed issues introducing JStorm's features but unfortunately no one is
> working on that.
>
> Instead, we are shipping our own improvements in Storm 2.0.0. Here's short
> summary to Storm 2.0.0 so please refer the link if you didn't see it.
>
> https://mail-archives.apache.org/mod_mbox/storm-user/201712.mbox/%
> 3CCAF5108j0iGxH7QdZKz81uxCTykQZZfNwpagEV_hYYhT8xmxYUg%40mail.gmail.com%3E
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
> 2017년 12월 31일 (일) 오전 11:42, Satish Duggana <sa...@gmail.com>님이
> 작성:
>
> > Hi Alexendre,
> > Event time windowing is already supported in Storm, you can go through
> > http://storm.apache.org/releases/2.0.0-SNAPSHOT/Windowing.html here.
> >
> > Thanks,
> > Satish.
> >
> > On Sat, Dec 30, 2017 at 3:24 PM, Alexandre Vermeerbergen <
> > avermeerbergen@gmail.com> wrote:
> >
> > > Hello,
> > >
> > > Unless I am mistaking, one of the Storm 2's targets includes a
> > convergence
> > > with JStorm.
> > > JStorm seems to have neat window-processing features and it is part of
> > > Apache Beam ecosystem, see:
> > > https://beam.apache.org/documentation/runners/capability-matrix/
> > >
> > > Will Storm 2.0.0 include JStorm windows processing features (in
> > particular,
> > > "event time"-based ones?)
> > > Will it have its Beam Runner?
> > >
> > > Also for Storm 2.0.0 : is there a plan to officially support Java 9, as
> > > ORACLE Java 8 is planned to reach end of public support by September
> 2018
> > > (see http://www.oracle.com/technetwork/java/eol-135779.html) ? (FYI
> > Kafka
> > > 1.0.0 has official Java 9 support)
> > >
> > > Best regards,
> > > Alexandre Vermeerbergen
> > >
> > >
> > > 2017-12-30 1:08 GMT+01:00 Jungtaek Lim <ka...@gmail.com>:
> > >
> > > > Hi devs,
> > > >
> > > > First of all, happy new year!
> > > > I'd like to ask for help on reviewing Storm 2.0.0 items, so that we
> > could
> > > > get closer on releasing Storm 2.0.0 (early, I hope) next year.
> > > >
> > > > STORM-2306 : Messaging subsystem redesign
> > > > https://github.com/apache/storm/pull/2241
> > > >
> > > > STORM-2693: Heartbeats and assignments promotion
> > > > https://github.com/apache/storm/pull/2433
> > > >
> > > > Please enumerate issues if you have any.
> > > >
> > > > Below is the item for 1.2.0, but if in case it can't be included in
> > > 1.2.0.
> > > >
> > > > STORM-2153: New Metrics Reporting API
> > > > https://github.com/apache/storm/pull/2203
> > > >
> > > > Thanks,
> > > > Jungtaek Lim (HeartSaVioR)
> > > >
> > >
> >
>