You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2020/10/08 17:12:28 UTC

[beam] branch master updated (e58d4e1 -> 1958eae)

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from e58d4e1  [BEAM-8017] Plumb errors and remove panics from package graphx (#13028)
     new 19ff045  Add support for gracefully aborting workers. On complete_work_status received (by the work progress updater thread), abort the corresponding map task executor thread.  This relies on Thread.interrupt() to unblock the worker thread if blocked and raise an exception -- the exception is actually ignored by the backend since the backend already decided to abort this thread.  Must also check the current thread for interrupts in the valuesiterator when it consumes a stream of  [...]
     new 42a4957  .
     new 0980283  .
     new c14d176  spotlessApply
     new c543663  .
     new ce47d21  Added async abort signaling up to the GroupingShuffleReader's (values) iterator
     new c1b61ac  Update abort message and add async abort signaling up to the GroupingShuffleReader's (values) iterator
     new cba6498  When aborting the work item, log the status received from the backend
     new 1958eae  Merge pull request #12994 from tudorm/worker-abort

The 29170 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../worker/DataflowWorkProgressUpdater.java        | 14 +++++++
 .../dataflow/worker/GroupingShuffleReader.java     | 48 +++++++++++++++++++---
 .../worker/util/common/worker/MapTaskExecutor.java | 21 +++++++++-
 .../worker/util/common/worker/NativeReader.java    |  9 ++++
 .../worker/util/common/worker/ReadOperation.java   | 18 ++++++++
 .../worker/DataflowWorkProgressUpdaterTest.java    | 23 +++++++++++
 .../util/common/worker/MapTaskExecutorTest.java    | 23 +++++++++++
 7 files changed, 150 insertions(+), 6 deletions(-)