You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Maja Kabiljo (JIRA)" <ji...@apache.org> on 2015/03/19 18:49:38 UTC

[jira] [Created] (GIRAPH-998) Close writers in parallel

Maja Kabiljo created GIRAPH-998:
-----------------------------------

             Summary: Close writers in parallel
                 Key: GIRAPH-998
                 URL: https://issues.apache.org/jira/browse/GIRAPH-998
             Project: Giraph
          Issue Type: Improvement
            Reporter: Maja Kabiljo
            Assignee: Maja Kabiljo
            Priority: Minor


When thread-safe per superstep output is used, in the end of application we close all the writers in a single thread. Closing a writer can take time, and we are not reporting progress while doing so, so it happens that tasks timeout during this stage. Doing it in multiple threads and calling progress while doing it will make it faster and prevent tasks from timing out.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)