You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by charlesccychen <gi...@git.apache.org> on 2017/07/26 18:01:49 UTC

[GitHub] beam pull request #3646: Do not merge: scratch work 2

GitHub user charlesccychen opened a pull request:

    https://github.com/apache/beam/pull/3646

    Do not merge: scratch work 2

    Follow this checklist to help us incorporate your contribution quickly and easily:
    
     - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
     - [ ] Each commit in the pull request should have a meaningful subject line and body.
     - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue.
     - [ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
     - [ ] Run `mvn clean verify` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
     - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/charlesccychen/beam streaming-test

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3646.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3646
    
----
commit c2b3f3222baf5dd7b1f107dc0bfcc7f8b5d49111
Author: Charles Chen <cc...@google.com>
Date:   2017-04-21T05:51:27Z

    Don't buffer elements in GroupByKeyOnly.

commit 3383c260855150dc9f0182a15f37136ea1b1c93c
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:50:02Z

    streaming test

commit 038f3f33297421237814124887564c6f2620711a
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:53:09Z

    Working TestStream evaluator

commit fc661f6e22fb2d4b648af345527ed67a32776754
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:54:09Z

    Slightly better watermark propagation, debugging print cleanup.

commit 053c7ae370df66d224469129f91fe8028ff3bcf4
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:55:42Z

    Factor out GroupAlsoByWindows so that it can be overridden by the DirectRunner.

commit 8854c53c1bc75631bd3b09b3f7ed6412eb93f844
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:56:53Z

    Skeleton implementation of GroupAlsoByKeyEvaluator.

commit ae0d80d0b945e8c50426696495e893565dc7db4a
Author: Charles Chen <cc...@google.com>
Date:   2017-04-24T15:16:05Z

    Rename old non-keyed state to legacy_state, introduce KeyedWorkItem, prepare to expose DirectUnmergedState API.

commit 8be01a96055fb92013f6fc5aed8edc2af6e75e42
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:57:30Z

    Mostly working streaming GroupAlsoByWindow.

commit bf38fe7afd219144e068d5dbd7035449f83bb723
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T21:58:08Z

    Introduce keyed bundles, KeyedWorkItems.

commit 97de55600417145702576424dc7512de3f981838
Author: Charles Chen <cc...@google.com>
Date:   2017-05-24T22:01:59Z

    Fix rebase to head after Beam 2.0 release.

commit 341fa9245e5d67cc5fab4244bfeca5ea49c72231
Author: Charles Chen <cc...@google.com>
Date:   2017-05-25T21:22:03Z

    Clarify transform_keyed_states.

commit 1e83d5e900c7039ccf89d989081ae50b3b3e510f
Author: Charles Chen <cc...@google.com>
Date:   2017-05-26T00:38:31Z

    Support timer firings.

commit 256309f2f3b01b230b258b8001a494d75e3e1713
Author: Charles Chen <cc...@google.com>
Date:   2017-05-26T01:08:44Z

    Reintroduce hacks from head.

commit 25ce9f18a124e8d0aa80e05a516699da6a067c19
Author: Charles Chen <cc...@google.com>
Date:   2017-05-26T21:12:59Z

    Add debugging output.

commit 7be85c67c5c405c16c146e5605dd2a5bb9bd3bdd
Author: Charles Chen <cc...@google.com>
Date:   2017-05-26T22:56:32Z

    Don't hold input watermark on pending elements.

commit 1df07a5b46811d0d3a383b156121d77f5f37aa57
Author: Charles Chen <cc...@google.com>
Date:   2017-05-30T18:26:03Z

    Finish moving earliest hold extraction to evaluators, dbg output++

commit e52ba42a9efe0961ed57da52e93fdd8e5970eedc
Author: Charles Chen <cc...@google.com>
Date:   2017-05-31T22:46:06Z

    Batch WordCount works in streaming mode!!
    
    Fixes earliest hold to be < instead of <=.

commit e5bb716e00ac02679edc3a357153009b862bb4d0
Author: Charles Chen <cc...@google.com>
Date:   2017-06-05T22:20:37Z

    Working batch and streaming mode execution, except for certain empty side
    inputs.

commit 91873cc1422d5bc7812464feea6789a1c4242577
Author: Robert Bradshaw <ro...@gmail.com>
Date:   2017-06-07T15:48:49Z

    PubSubIO for direct runner.

commit e05778fc1245b75a34f63b4a29d1e7c2decab053
Author: Charles Chen <ch...@users.noreply.github.com>
Date:   2017-06-07T17:14:07Z

    Merge pull request #1 from robertwb/streaming
    
    PubSubIO for direct runner.

commit 12a95178163ef3bf56f49f6276194e2ab0068999
Author: Charles Chen <cc...@google.com>
Date:   2017-06-08T22:12:14Z

    Use keyed holds in watermark manager

commit b90a2e45b6b39d3d6c513218a1ec3ae9e1edca27
Author: Charles Chen <cc...@google.com>
Date:   2017-06-09T15:53:03Z

    Fix dropped messages in PubSubRead.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam pull request #3646: Do not merge: scratch work 2

Posted by charlesccychen <gi...@git.apache.org>.
Github user charlesccychen closed the pull request at:

    https://github.com/apache/beam/pull/3646


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---