You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by Thomas Weise <th...@datatorrent.com> on 2016/01/22 01:51:16 UTC

Wrapping up APEXCORE-60 for release

The remaining piece for first cut is APEXCORE-306.

We need to ensure that operators in the loop (strongly connected) move
recovery checkpoint lockstep. Identifying the loop will be done with the
existing logic in LogicalPlan. What I have so far is first cut changes to
updateRecoveryCheckpoints, using the group of logical operators to compute
the checkpoint dependencies:

https://github.com/tweise
/incubator-apex-core/commit/fc672a6f46f1f6c76c552ecee0740b795129fc0c

David, Gaurav, Pramod please have a look. We aim to complete this EOW for
the release candidate.

I'm working on identifying the checkpoint groups now, will have that ready
later tonight.

Thanks

Re: Wrapping up APEXCORE-60 for release

Posted by Thomas Weise <th...@datatorrent.com>.
I added the changes to identify the checkpoint groups based on the logical
plan:

https://github.com/tweise/incubator-apex-core/commits/APEXCORE-60

David,

The 2 recovery tests fail, please have a look.

Thanks

On Thu, Jan 21, 2016 at 5:49 PM, Pramod Immaneni <pr...@datatorrent.com>
wrote:

> Looks good so far Thomas
>
> On Thu, Jan 21, 2016 at 4:51 PM, Thomas Weise <th...@datatorrent.com>
> wrote:
>
> > The remaining piece for first cut is APEXCORE-306.
> >
> > We need to ensure that operators in the loop (strongly connected) move
> > recovery checkpoint lockstep. Identifying the loop will be done with the
> > existing logic in LogicalPlan. What I have so far is first cut changes to
> > updateRecoveryCheckpoints, using the group of logical operators to
> compute
> > the checkpoint dependencies:
> >
> > https://github.com/tweise
> > /incubator-apex-core/commit/fc672a6f46f1f6c76c552ecee0740b795129fc0c
> >
> > David, Gaurav, Pramod please have a look. We aim to complete this EOW for
> > the release candidate.
> >
> > I'm working on identifying the checkpoint groups now, will have that
> ready
> > later tonight.
> >
> > Thanks
> >
>

Re: Wrapping up APEXCORE-60 for release

Posted by Pramod Immaneni <pr...@datatorrent.com>.
Looks good so far Thomas

On Thu, Jan 21, 2016 at 4:51 PM, Thomas Weise <th...@datatorrent.com>
wrote:

> The remaining piece for first cut is APEXCORE-306.
>
> We need to ensure that operators in the loop (strongly connected) move
> recovery checkpoint lockstep. Identifying the loop will be done with the
> existing logic in LogicalPlan. What I have so far is first cut changes to
> updateRecoveryCheckpoints, using the group of logical operators to compute
> the checkpoint dependencies:
>
> https://github.com/tweise
> /incubator-apex-core/commit/fc672a6f46f1f6c76c552ecee0740b795129fc0c
>
> David, Gaurav, Pramod please have a look. We aim to complete this EOW for
> the release candidate.
>
> I'm working on identifying the checkpoint groups now, will have that ready
> later tonight.
>
> Thanks
>