You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2014/01/09 04:12:50 UTC

[jira] [Created] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

Siddharth Seth created TEZ-714:
----------------------------------

             Summary: OutputCommitters should not run in the main AM dispatcher thread
                 Key: TEZ-714
                 URL: https://issues.apache.org/jira/browse/TEZ-714
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Siddharth Seth
            Priority: Critical


Follow up jira from TEZ-41.
1) If there's multiple OutputCommitters on a Vertex, they can be run in parallel.
2) Running an OutputCommitter in the main thread blocks all other event handling, w.r.t the DAG, and causes the event queue to back up.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)