You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@samza.apache.org by nickpan47 <gi...@git.apache.org> on 2018/08/13 08:09:52 UTC

[GitHub] samza pull request #606: SAMZA-1789: unify ApplicationDescriptor and Applica...

GitHub user nickpan47 opened a pull request:

    https://github.com/apache/samza/pull/606

    SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

    This is the initial PR for SEP-13. High-lighted changes:
    - Define StreamApplication and TaskApplication with describe(ApplicationDescriptor) API to define processing logic of a Stream application
       - the objects instantiated and registered to ApplicationDescriptor in describe() method should be serializable
    - Define ApplicationRunner to have mandatory constructor parameter of ApplicationDescriptor
    - Define ProcessorLifecycleListenerFactory to allow user inject local logic and instantiate local objects in the processors in an application 

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/nickpan47/samza app-runtime-with-processor-callbacks

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/606.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #606
    
----
commit 8e6fc2dac5af11f0748fdcd32175c2ae95418fc7
Author: prateekm <pr...@...>
Date:   2018-06-09T22:01:10Z

    Remove all usages of StreamSpec and ApplicationRunner from the operator spec and impl layers.

commit 7d7aa50882d656143ea6fbc8064aca390024dd31
Author: Prateek Maheshwari <pm...@...>
Date:   2018-06-13T19:56:51Z

    Updated with Cameron and Daniel's feedback.

commit 8561930133a0da52061bceee3596d02c6c7f9370
Author: Prateek Maheshwari <pr...@...>
Date:   2018-06-15T22:25:50Z

    Merge branch 'master' into stream-spec-cleanup

commit 7e71dc7e04c5e1a0357663a76068d3dead4ebfd8
Author: Yi Pan (Data Infrastructure) <yi...@...>
Date:   2018-06-27T22:22:17Z

    Merge with master

commit f1cb8f0eb29feefe7e01c4a159f8792b5df0ce39
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-07-10T17:55:20Z

    Merge branch 'master' into single-app-api-May-21-18

commit d43e923192b8b78a9eb6ba4ba15a05151ec457f2
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-07-11T04:30:12Z

    WIP: proto-type with ApplicationRunnable and no ApplicationRunner exposed to user

commit 42782d815133ee75757c831f60a67f6980069e18
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-07-17T21:54:06Z

    Merge branch 'prateek-remove-app-runner-stream-spec' into app-spec-with-app-runtime-Jul-16-18

commit 95577b74c7330f11ee055c363b944c745f034ee0
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-07-18T10:09:52Z

    WIP: trying to figure out the two interface classes for spec: a) spec builder in init(); b) spec reader in all other lifecycle methods

commit 30a4e5f0ae6ff1b99fc8a6d08e742d8bff06e0cb
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-07-23T09:02:06Z

    WIP: application runner refactor - proto-type for SEP-13

commit fb1bc49e04c5a420c22c3589c39eb08a2964d01d
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-07-30T20:55:59Z

    Merge branch 'master' into app-spec-with-app-runtime-Jul-16-18

commit 973eb5261432da50a3540c96a101136f9c854f1d
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-08-03T19:08:30Z

    WIP: compiles, still working on LocalContainerRunner refactor

commit f20cdcda68ebf96924ece4ad16fbe25a9b370323
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-08-06T08:32:03Z

    WIP: adding unit tests. Pending update on StreamProcessorLifecycleListener, LocalContainerRunner, and SamzaContainerListener

commit c4bb0dce6f812d19a5dcf02f19b7c2e455120bfd
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-08-06T17:46:11Z

    Merge branch 'master' into app-runtime-with-processor-callbacks

commit a82708bb0f509affba19a81a0b2a10b2d8191df8
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-08-13T06:52:45Z

    SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

commit 014337170811527f7d3dcbe5af9e6ec353dc3efd
Author: Yi Pan (Data Infrastructure) <ni...@...>
Date:   2018-08-13T07:48:21Z

    Merge branch 'master' into app-runtime-with-processor-callbacks

----


---

[GitHub] samza pull request #606: SAMZA-1789: unify ApplicationDescriptor and Applica...

Posted by asfgit <gi...@git.apache.org>.

Github user asfgit closed the pull request at:

    https://github.com/apache/samza/pull/606


---