You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Gil Vernik (JIRA)" <ji...@apache.org> on 2017/03/06 11:25:32 UTC

[jira] [Created] (MAPREDUCE-6857) Reduce number of exists() calls on the target object

Gil Vernik created MAPREDUCE-6857:
-------------------------------------

             Summary: Reduce number of exists() calls on the target object
                 Key: MAPREDUCE-6857
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6857
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: distcp
    Affects Versions: 3.0.0-alpha2
            Reporter: Gil Vernik
             Fix For: 3.0.0-alpha2


CopyMapper.map(..) calls targetStatus = targetFS.getFileStatus(target).
Few steps later RetriableFileCopyCommand.promoteTmpToTarget(..) will call again exists(target) and delete if present. 
The second exists() is useless, since if targetStatus==null it can be easily seen  if overwrite mode is activated and so target object can be deleted.

The propose of this patch is to delete target object by using targetStatus and thus avoid calling exists() method.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org