You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by jk...@apache.org on 2017/11/15 03:43:06 UTC

[2/2] beam git commit: This closes #4124: [BEAM-3169] Fixes a data loss bug in WriteFiles when used with fire-once triggers

This closes #4124: [BEAM-3169] Fixes a data loss bug in WriteFiles when used with fire-once triggers


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/209bb6d7
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/209bb6d7
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/209bb6d7

Branch: refs/heads/master
Commit: 209bb6d748bb776cdb5d93729144ba34dd9cb967
Parents: 9f780c9 2eea9fe
Author: Eugene Kirpichov <ki...@google.com>
Authored: Tue Nov 14 19:34:42 2017 -0800
Committer: Eugene Kirpichov <ki...@google.com>
Committed: Tue Nov 14 19:34:42 2017 -0800

----------------------------------------------------------------------
 .../apex/translation/ParDoTranslator.java       |   2 +-
 .../runners/apex/examples/WordCountTest.java    |   2 +-
 .../construction/WriteFilesTranslationTest.java |   1 -
 .../beam/runners/spark/io/AvroPipelineTest.java |  12 +-
 .../org/apache/beam/sdk/io/FileBasedSink.java   | 169 ++++-----
 .../java/org/apache/beam/sdk/io/WriteFiles.java | 375 ++++++++++++-------
 .../apache/beam/sdk/io/FileBasedSinkTest.java   |  77 ++--
 .../org/apache/beam/sdk/io/TextIOWriteTest.java |  84 +++--
 .../org/apache/beam/sdk/io/WriteFilesTest.java  |  47 ++-
 9 files changed, 451 insertions(+), 318 deletions(-)
----------------------------------------------------------------------