You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "Thomas Weise (JIRA)" <ji...@apache.org> on 2017/01/04 18:15:58 UTC

[jira] [Created] (APEXCORE-599) Data not fully processed when operator terminates via ShutdownException

Thomas Weise created APEXCORE-599:
-------------------------------------

             Summary: Data not fully processed when operator terminates via ShutdownException
                 Key: APEXCORE-599
                 URL: https://issues.apache.org/jira/browse/APEXCORE-599
             Project: Apache Apex Core
          Issue Type: Bug
    Affects Versions: 3.5.0
            Reporter: Thomas Weise


Observed in the form of flaky unit tests in Beam. The pipelines terminate using shutdown by the operator when there is no more input and occasionally the test will fail because the cluster exits without having processed fully. The bandaid is to have a delay before shutdown is issued, allowing the last tuples to be pushed downstream. See BEAM-1140 for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)