You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2021/10/28 15:44:00 UTC

[jira] [Created] (MAPREDUCE-7367) Parallelize file moves in FileOutputCommitter v1 job commit

Steve Loughran created MAPREDUCE-7367:
-----------------------------------------

             Summary: Parallelize file moves in FileOutputCommitter v1 job commit
                 Key: MAPREDUCE-7367
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7367
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mrv2
    Affects Versions: 3.4.0
            Reporter: Steve Loughran
            Assignee: Rajesh Balamohan


add options to v1 job commit to scan TA dirs and rename files in parallel.

This is work by Rajesh Balamohan which is an interim patch before MAPREDUCE-7341 -I Don't intend to merge it). It will be the commit before HADOOP-17981



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org