You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by pa...@apache.org on 2018/10/16 22:39:28 UTC

[beam] branch master updated (287d48d -> 2f07e6b)

This is an automated email from the ASF dual-hosted git repository.

pabloem pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 287d48d  Merge pull request #6680 from HuangLED/pyJar
     add 83d2293  Work on a streaming impulse source
     add 357d192  fix example job
     add aed5b7e  Review updates
     add 2bb2332  Message count for StreamingImpulseSource is now cluster-wide rather than per-subtask
     add a1baf7c  Fix style errors
     new 2f07e6b  Merge pull request #6637 from lyft/micah_impulse_source

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../FlinkStreamingPortablePipelineTranslator.java  | 43 +++++++++++
 .../streaming/io/StreamingImpulseSource.java       | 73 ++++++++++++++++++
 .../{io/gcp/tests => examples/flink}/__init__.py   |  0
 .../examples/flink/flink_streaming_impulse.py      | 86 ++++++++++++++++++++++
 .../io/{gcp/tests => flink}/__init__.py            |  0
 .../io/flink/flink_streaming_impulse_source.py     | 77 +++++++++++++++++++
 6 files changed, 279 insertions(+)
 create mode 100644 runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/io/StreamingImpulseSource.java
 copy sdks/python/apache_beam/{io/gcp/tests => examples/flink}/__init__.py (100%)
 create mode 100644 sdks/python/apache_beam/examples/flink/flink_streaming_impulse.py
 copy sdks/python/apache_beam/io/{gcp/tests => flink}/__init__.py (100%)
 create mode 100644 sdks/python/apache_beam/io/flink/flink_streaming_impulse_source.py

[beam] 01/01: Merge pull request #6637 from lyft/micah_impulse_source

Posted by pa...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 2f07e6b6b10412b69e48e11abf9bd4ebdf1462d4
Merge: 287d48d a1baf7c
Author: Pablo <pa...@users.noreply.github.com>
AuthorDate: Tue Oct 16 15:39:10 2018 -0700

    Merge pull request #6637 from lyft/micah_impulse_source
    
    [BEAM-5707] Add a periodic, streaming impulse source for Flink portable pipelines

 .../FlinkStreamingPortablePipelineTranslator.java  | 43 +++++++++++
 .../streaming/io/StreamingImpulseSource.java       | 73 ++++++++++++++++++
 sdks/python/apache_beam/examples/flink/__init__.py | 18 +++++
 .../examples/flink/flink_streaming_impulse.py      | 86 ++++++++++++++++++++++
 sdks/python/apache_beam/io/flink/__init__.py       | 18 +++++
 .../io/flink/flink_streaming_impulse_source.py     | 77 +++++++++++++++++++
 6 files changed, 315 insertions(+)