You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Forest Tan (JIRA)" <ji...@apache.org> on 2011/02/11 09:16:57 UTC

[jira] Created: (MAPREDUCE-2319) MultithreadedMapper doesn't update completion percentage before mapper is finished

MultithreadedMapper doesn't update completion percentage before mapper is finished
----------------------------------------------------------------------------------

                 Key: MAPREDUCE-2319
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2319
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
    Affects Versions: 0.20.2
            Reporter: Forest Tan


MultithreadedMapper runs multiple threads in one mapper, but it doesn't update the completion percentage before all the threads are completed.

If is better to update the completion percentage when threads are running to reflect real progress.

The code is like this:
runners = new ArrayList(numberOfThreads);
        for(int i = 0; i < numberOfThreads; i++)
        {
            MapRunner thread = new MapRunner(context);
            thread.start();
            runners.add(i, thread);
        }

        for(int i = 0; i < numberOfThreads; i++)
        {
            MapRunner thread = (MapRunner)runners.get(i);
            thread.join(); // wait
            ...       
        }

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira