You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2009/04/15 01:12:14 UTC

[jira] Created: (HADOOP-5675) DistCp should not launch a job if byteCount == 0

DistCp should not launch a job if byteCount == 0
------------------------------------------------

                 Key: HADOOP-5675
                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
             Project: Hadoop Core
          Issue Type: Improvement
            Reporter: Tsz Wo (Nicholas), SZE
            Assignee: Tsz Wo (Nicholas), SZE
            Priority: Minor


Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if byteCount == 0

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699994#action_12699994 ] 

Hadoop QA commented on HADOOP-5675:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12405477/5675_20090414.patch
  against trunk revision 765815.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no tests are needed for this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/204/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/204/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/204/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/204/console

This message is automatically generated.

> DistCp should not launch a job if byteCount == 0
> ------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>         Attachments: 5675_20090414.patch
>
>
> Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705837#action_12705837 ] 

Tsz Wo (Nicholas), SZE commented on HADOOP-5675:
------------------------------------------------

Tested manually.  No new tests added.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12706157#action_12706157 ] 

Hudson commented on HADOOP-5675:
--------------------------------

Integrated in Hadoop-trunk #827 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/827/])
    . Do not launch a job if DistCp has no work to do. Contributed by Tsz Wo (Nicholas), SZE


> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Attachment: 5675_20090428.patch

5675_20090428.patch: renamed "sourceFilesCount" to "sourcePathsCount" since the count also includes directories.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

     Description: Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.  (was: Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.)
    Hadoop Flags:   (was: [Reviewed])
         Summary: DistCp should not launch a job if it is not necessary  (was: DistCp should not launch a job if byteCount == 0)

If there are only zero length files, we have byteCount == 0.  However, DistCp should launch a job to copy these zero length files in this case.  Instead of byteCount, we should use fileCount, which counts how many files needed to be copied.

Edited summary and description to reflect this.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>         Attachments: 5675_20090414.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if byteCount == 0

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Component/s: tools/distcp

> DistCp should not launch a job if byteCount == 0
> ------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>
> Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708640#action_12708640 ] 

Hudson commented on HADOOP-5675:
--------------------------------

Integrated in Hadoop-trunk #834 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/834/])
    . Do not launch a job if DistCp has no work to do. Contributed by Tsz Wo (Nicholas), SZE
Revert 


> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Status: Patch Available  (was: Open)

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas updated HADOOP-5675:
----------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

I committed this. Thanks, Nicholas

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Reopened: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas reopened HADOOP-5675:
-----------------------------------


I committed the wrong patch.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Attachment: 5675_20090421.patch

5675_20090421.patch: use fileCount

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Attachment: 5675_20090422.patch

Suhas, thanks for your comment.

5675_20090422.patch: changed the log messages.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701348#action_12701348 ] 

Suhas Gogate commented on HADOOP-5675:
--------------------------------------

Tested the patch and here are some comments w.r.t. following output I see,

1. suggestions for counter names:  srcCount => sourceFilesCount,  fileCount => filesToCopyCount,  byteCount => bytesToCopyCount

2. Remove white spaces between counter name and value. 

09/04/21 23:37:30 INFO tools.DistCp: srcCount = 6
09/04/21 23:37:30 INFO tools.DistCp: fileCount= 2
09/04/21 23:37:30 INFO tools.DistCp: byteCount= 341.5k


> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Fix Version/s: 0.21.0
           Status: Open  (was: Patch Available)

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705838#action_12705838 ] 

Chris Douglas commented on HADOOP-5675:
---------------------------------------

+1

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12704472#action_12704472 ] 

Hadoop QA commented on HADOOP-5675:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12406687/5675_20090428.patch
  against trunk revision 769923.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no tests are needed for this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/262/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/262/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/262/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/262/console

This message is automatically generated.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-5675) DistCp should not launch a job if it is not necessary

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas resolved HADOOP-5675.
-----------------------------------

    Resolution: Fixed

I (re)committed this.

> DistCp should not launch a job if it is not necessary
> -----------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: 5675_20090414.patch, 5675_20090421.patch, 5675_20090422.patch, 5675_20090428.patch
>
>
> Currently, DistCp launch a job even if it is not necessary.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5675) DistCp should not launch a job if byteCount == 0

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699029#action_12699029 ] 

Chris Douglas commented on HADOOP-5675:
---------------------------------------

+1

> DistCp should not launch a job if byteCount == 0
> ------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>         Attachments: 5675_20090414.patch
>
>
> Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if byteCount == 0

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Attachment: 5675_20090414.patch

5675_20090414.patch: not starting a job if there is no bytes.

> DistCp should not launch a job if byteCount == 0
> ------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>         Attachments: 5675_20090414.patch
>
>
> Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5675) DistCp should not launch a job if byteCount == 0

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-5675:
-------------------------------------------

    Hadoop Flags: [Reviewed]
          Status: Patch Available  (was: Open)

> DistCp should not launch a job if byteCount == 0
> ------------------------------------------------
>
>                 Key: HADOOP-5675
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5675
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Minor
>         Attachments: 5675_20090414.patch
>
>
> Currently, DistCp launch a job even if byteCount == 0.  In such case, the job does nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.