You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Danny McCormick (Jira)" <ji...@apache.org> on 2022/06/03 15:27:00 UTC

[jira] [Commented] (BEAM-819) The DirectRunner can complete before reporting the results of all ModelEnforcements

    [ https://issues.apache.org/jira/browse/BEAM-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17546040#comment-17546040 ] 

Danny McCormick commented on BEAM-819:
--------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/17940

> The DirectRunner can complete before reporting the results of all ModelEnforcements
> -----------------------------------------------------------------------------------
>
>                 Key: BEAM-819
>                 URL: https://issues.apache.org/jira/browse/BEAM-819
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-direct
>            Reporter: Thomas Groh
>            Priority: P3
>
> The termination condition in the ExecutorServiceParallelExecutor.MonitorRunnable checks to see if the evaluation context is done, among other things. Due to the signatures of ModelEnforcement, output is committed before ModelEnforcement runs to ensure that the enforcement has access to the final elements. If the transform that performs ModelEnforcement completes, and all PTransforms are done, the pipeline can shutdown before model enforcement fails.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)