You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Yi Pan <ni...@gmail.com> on 2018/08/02 17:49:53 UTC

Re: [DISCUSS] SEP-13: refactor application runtime classes to unify describe and launch the low- and high-level applications in YARN and standalone

Hi, all,

SEP-13 is updated to address some comments from offline discussion.
Main high-lighted change:
Separate the ProcessorLifecycleListener API from LifecycleAwareApplication,
such that describe the processing logic and injection of customized logic
in application process lifecycle are in two interfaces. It is also made
clear that ProcessorLifecycleListener is only applied in local application
processors (i.e. standalone process or container process in NodeManager in
YARN) which actually runs the user application logic.

Please take a look at the revised doc.

Thanks!

-Yi

On Fri, Jul 27, 2018 at 2:23 PM, Yi Pan <ni...@gmail.com> wrote:

> Title is wrong. Updated.
>
> On Fri, Jul 27, 2018 at 10:33 AM, Yi Pan <ni...@gmail.com> wrote:
>
>> Hi, all,
>>
>> Here is the proposal: https://cwiki.apache.org/confluence/display/SAMZA/
>> SEP-13%3A+unify+high-+and+low-level+user+applications+in+
>> YARN+and+standalone
>>
>> Thanks!
>>
>> -Yi
>>
>
>

Re: [DISCUSS] SEP-13: refactor application runtime classes to unify describe and launch the low- and high-level applications in YARN and standalone

Posted by Yi Pan <ni...@gmail.com>.
One more revision on SEP-13:
https://cwiki.apache.org/confluence/display/SAMZA/SEP-13%3A+unify+high-+and+low-level+user+applications+in+YARN+and+standalone

and the initial PR is uploaded: https://github.com/apache/samza/pull/606

Thanks!

On Thu, Aug 2, 2018 at 10:49 AM, Yi Pan <ni...@gmail.com> wrote:

> Hi, all,
>
> SEP-13 is updated to address some comments from offline discussion.
> Main high-lighted change:
> Separate the ProcessorLifecycleListener API from
> LifecycleAwareApplication, such that describe the processing logic and
> injection of customized logic in application process lifecycle are in two
> interfaces. It is also made clear that ProcessorLifecycleListener is only
> applied in local application processors (i.e. standalone process or
> container process in NodeManager in YARN) which actually runs the user
> application logic.
>
> Please take a look at the revised doc.
>
> Thanks!
>
> -Yi
>
> On Fri, Jul 27, 2018 at 2:23 PM, Yi Pan <ni...@gmail.com> wrote:
>
>> Title is wrong. Updated.
>>
>> On Fri, Jul 27, 2018 at 10:33 AM, Yi Pan <ni...@gmail.com> wrote:
>>
>>> Hi, all,
>>>
>>> Here is the proposal: https://cwiki.apache.org/confluence/display/SAMZA/
>>> SEP-13%3A+unify+high-+and+low-level+user+applications+in+YAR
>>> N+and+standalone
>>>
>>> Thanks!
>>>
>>> -Yi
>>>
>>
>>
>