7/2/2019 Bi-Weekly OSS Heron Sync-up

[Ning Wang <wa...@gmail.com>]

Hi, all~,

It has been two weeks since our last sync! Let's share our works for the
last two weeks in this thread.

My updates:
- investigation on rate limit is done. The feature works as expected in
both Storm and Heron API. We did find out that Java serializer caused some
IO issue in a high throughput job. I am thinking of making Kryo as default
serializer with Heron API. Any thoughts are welcome.
- Prepared 0.20.1 rc3 for vote. BTW, please vote!
- Some discussions about 2-phase commit.

Regards,
--ning

Re: 7/2/2019 Bi-Weekly OSS Heron Sync-up

[Xiaoyao Qian <qi...@illinois.edu>]

My updates:
Added spout specific extra links to heron UI, which could be handy to debug
topologies failures.

On Thu, Jul 4, 2019 at 00:55 Ning Wang <wa...@gmail.com> wrote:

> KK. Thanks for the input!
>
> On Wed, Jul 3, 2019 at 8:42 PM Josh Fischer <jo...@joshfischer.io> wrote:
>
> > Hi all,
> >
> > I added javadoc generation to the new static site.
> >
> > Ning,
> > I think we should make Kryo the default serializer and update docs to
> > reflect anything that needs to be known about the change. (Docs on the
> new
> > site of course)
> >
> >
> > On Tue, Jul 2, 2019 at 2:19 AM Ning Wang <wa...@gmail.com> wrote:
> >
> > > Hi, all~,
> > >
> > > It has been two weeks since our last sync! Let's share our works for
> the
> > > last two weeks in this thread.
> > >
> > > My updates:
> > > - investigation on rate limit is done. The feature works as expected in
> >
> >
> >
> > > both Storm and Heron API. We did find out that Java serializer caused
> > some
> > > IO issue in a high throughput job. I am thinking of making Kryo as
> > default
> > > serializer with Heron API. Any thoughts are welcome.
> > > - Prepared 0.20.1 rc3 for vote. BTW, please vote!
> > > - Some discussions about 2-phase commit.
> > >
> > > Regards,
> > > --ning
> > >
> > --
> > Sent from A Mobile Device
> >
>
-- 
Xiaoyao Qian
University of Illinois-Urbana-Champaign
MS Computer Science
Email: qian13@illinois.edu
Tel: (217)-898-7641

Re: 7/2/2019 Bi-Weekly OSS Heron Sync-up

[Ning Wang <wa...@gmail.com>]

KK. Thanks for the input!

On Wed, Jul 3, 2019 at 8:42 PM Josh Fischer <jo...@joshfischer.io> wrote:

> Hi all,
>
> I added javadoc generation to the new static site.
>
> Ning,
> I think we should make Kryo the default serializer and update docs to
> reflect anything that needs to be known about the change. (Docs on the new
> site of course)
>
>
> On Tue, Jul 2, 2019 at 2:19 AM Ning Wang <wa...@gmail.com> wrote:
>
> > Hi, all~,
> >
> > It has been two weeks since our last sync! Let's share our works for the
> > last two weeks in this thread.
> >
> > My updates:
> > - investigation on rate limit is done. The feature works as expected in
>
>
>
> > both Storm and Heron API. We did find out that Java serializer caused
> some
> > IO issue in a high throughput job. I am thinking of making Kryo as
> default
> > serializer with Heron API. Any thoughts are welcome.
> > - Prepared 0.20.1 rc3 for vote. BTW, please vote!
> > - Some discussions about 2-phase commit.
> >
> > Regards,
> > --ning
> >
> --
> Sent from A Mobile Device
>

Re: 7/2/2019 Bi-Weekly OSS Heron Sync-up

[Josh Fischer <jo...@joshfischer.io>]

Hi all,

I added javadoc generation to the new static site.

Ning,
I think we should make Kryo the default serializer and update docs to
reflect anything that needs to be known about the change. (Docs on the new
site of course)


On Tue, Jul 2, 2019 at 2:19 AM Ning Wang <wa...@gmail.com> wrote:

> Hi, all~,
>
> It has been two weeks since our last sync! Let's share our works for the
> last two weeks in this thread.
>
> My updates:
> - investigation on rate limit is done. The feature works as expected in



> both Storm and Heron API. We did find out that Java serializer caused some
> IO issue in a high throughput job. I am thinking of making Kryo as default
> serializer with Heron API. Any thoughts are welcome.
> - Prepared 0.20.1 rc3 for vote. BTW, please vote!
> - Some discussions about 2-phase commit.
>
> Regards,
> --ning
>
-- 
Sent from A Mobile Device