You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2015/04/03 00:45:52 UTC

[jira] [Created] (TEZ-2268) Add an event to indicate that all events are available

Siddharth Seth created TEZ-2268:
-----------------------------------

             Summary: Add an event to indicate that all events are available
                 Key: TEZ-2268
                 URL: https://issues.apache.org/jira/browse/TEZ-2268
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Siddharth Seth
            Assignee: Siddharth Seth


Instead of relying on event counts, it'll be useful to have a single event indicate that all events have been generated.
We'll have to guarantee ordering of events to be after all events are actually sent over.

EdgeManagers, unless specialized, cannot generate these events. They could, however, be linked to source Vertex completion.

Inputs / Outputs could use this to simplify tracking. Failures are the only events which could come in after this - which can be ignored by Inputs if they have already fetched the relevant data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)