You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Daryn Sharp (Created) (JIRA)" <ji...@apache.org> on 2012/03/02 01:44:57 UTC

[jira] [Created] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

FsShell put doesn't correctly handle a non-existent dir
-------------------------------------------------------

                 Key: HADOOP-8131
                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 0.23.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp
            Priority: Critical


{noformat}
$ hadoop fs -ls
ls: `.': No such file or directory
$ hadoop fs -put file
$ hadoop fs -ls
Found 1 items
-rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
{noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221184#comment-13221184 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #618 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/618/])
    svn merge -c 1296386 trunk to branch-0.23 FIXES HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296389)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296389
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221575#comment-13221575 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #214 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/214/])
    svn merge -c 1296386 trunk to branch-0.23 FIXES HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296389)

     Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296389
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221075#comment-13221075 ] 

Hadoop QA commented on HADOOP-8131:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516856/HADOOP-8131.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 7 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/659//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/659//console

This message is automatically generated.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Attachment: HADOOP-8131.patch

Made behavior consistent with other arg handling of put by throwing FNF if parent dir of a copy doesn't exists.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238433#comment-13238433 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

@Eli: I believe the auto-create was removed with the earlier redesign but crept back in later so I didn't view this particular jira as incompatible.  Since the goal has been to mimic the real shell, this non-posix "feature" was intentionally (again?) removed to solve this jira.

It also resolves the inconsistency between single source vs. multiple sources copies.  Single source copy would formerly auto-create non-existent dirs, but a multi-source copy fails if the target isn't an existing dir.  Ergo, copying a glob to a non-existent path was indeterminate depending on the number of glob matches: 1 match auto-created, more than 1 match failed.

Internally, we found the impact to be minimal (a single mkdir), so we favored retaining the posix semantics of copy.  Some relied on the auto-create because mkdir failed if the directory already exists, thus HADOOP-8175 added a -p flag.

If you feel strongly on restoring the former non-posix behavior and single/multi source inconsistency, I can look into doing so.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Status: Patch Available  (was: Open)
    
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Koji Noguchi (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239058#comment-13239058 ] 

Koji Noguchi commented on HADOOP-8131:
--------------------------------------

Todd, Daryn,
When users create their own outputs inside the streaming script, we ask them to use _temporary.
"hadoop dfs -___  ${mapred_work_output_dir}/mycutom_path-${mapred_tip_id}" or something like that. 

I do not want to see _temporary left out when jobs finish successfully.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Attachment: HADOOP-8131.patch

Fixed the other test to refer to directories in the test build root so it doesn't pass or fail based on whether /test exists.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221565#comment-13221565 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #186 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/186/])
    svn merge -c 1296386 trunk to branch-0.23 FIXES HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296389)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296389
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Attachment: HADOOP-8131.patch
    
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237392#comment-13237392 ] 

Eli Collins commented on HADOOP-8131:
-------------------------------------

Hey Daryn,

Should we restore the old behavior for 23? This is going to break people, eg scripts that  
do hadoop fs -put file1 dir1/file1 w/o dir1 already created used to work and won't anymore.

Thanks,
Eli

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221024#comment-13221024 ] 

Robert Joseph Evans commented on HADOOP-8131:
---------------------------------------------

I am getting a test failure, and Jenkins has not yet reported back its results.

Running org.apache.hadoop.fs.TestFsShellReturnCode
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.115 sec <<< FAILURE!

I get the same failure each time.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221020#comment-13221020 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

Test is passing for me!!  It appears to be referring to paths in /tmp, will see what happens when I create those files as debris.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220547#comment-13220547 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

When using a 1-arg put, the shell default to using the pwd.  If the target doesn't exist, the shell assumes it's a rename of the src file.  So the temp file "$p._COPYING_" becomes ".._COPYING_". The move at the end of the copy tries to rename the temp file to ".", which is interpreted as the pwd, so the rename is a no-op.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221025#comment-13221025 ] 

Robert Joseph Evans commented on HADOOP-8131:
---------------------------------------------

Oh wait so did Jenkins
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221212#comment-13221212 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1828 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1828/])
    HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296386)

     Result = ABORTED
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296386
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221015#comment-13221015 ] 

Hadoop QA commented on HADOOP-8131:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516848/HADOOP-8131.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.fs.TestFsShellReturnCode

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/658//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/658//console

This message is automatically generated.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238677#comment-13238677 ] 

Todd Lipcon commented on HADOOP-8131:
-------------------------------------

bq. Just to confirm: you mean a real conf key, not a cmdline flag, right?
Yep - something that could be set system-wide in core-site.xml. When users upgrade, they expect they may have to tweak some confs for the new version, but it's harder to ask them to change all of their shell scripts.

bq. In either case it will be a "change now or change later" scenario
Right. The idea is that they would have some warning (a full major version) before their code stops working. Our general policy is to only make the breaking change after having the deprecated support for a full major version -- in which case it would go away in 0.24.0.

bq. Would this bring back the issue of left out _temporary dirs? (MAPREDUCE-1272)
I would think the MR task would be using the new non-deprecated API which doesn't recursively create parents.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238646#comment-13238646 ] 

Todd Lipcon commented on HADOOP-8131:
-------------------------------------

If it's not too huge a pain, I'd be in favor of a deprecated config flag which restores the old behavior (while emitting a warning that it's deprecated and to be removed in a future version). This will help people migrate to 0.23, since I'm sure there are lots of cases where people have shell scripts running as part of production workflows.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Status: Open  (was: Patch Available)

wrong patch, missing file
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221571#comment-13221571 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #973 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/973/])
    HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296386)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296386
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221220#comment-13221220 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #628 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/628/])
    svn merge -c 1296386 trunk to branch-0.23 FIXES HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296389)

     Result = ABORTED
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296389
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13239467#comment-13239467 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

Koji, what is the ___ command?  A copy, and you omitted the source for brevity?  Does one of the variables in the target reference _temporary?  I'll probably need to investigate further after your clarification.  Thanks.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Attachment: HADOOP-8131.patch

Removed unnecessary commented code in the test.  FsShell dumps to stdout/stderr so I had to print to stdout to properly interlace the output.  That's also what other FsShell tests do.

The equals stuff is checking the basename of the path to catch ., .., dir/, dir/., dir/.. since Path will eat the chars off when it normalizes and/or fully qualifies.  That makes it "look" like a non-existent file.  The shell tracks the exact path supplied by the user, so it checks that basename for "it's a dir" conditions.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221026#comment-13221026 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

Test is referring to path outside build.test.root -- /test.  I have a /test directory...  Will fix the test.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238676#comment-13238676 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

No, it wouldn't bring back _temporary dirs because that appears unrelated to FsShell.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221587#comment-13221587 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #1008 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1008/])
    HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296386)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296386
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Bilung Lee (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bilung Lee updated HADOOP-8131:
-------------------------------

    Hadoop Flags: Incompatible change

Mark this as an incompatible change as the code throws an exception now but it doesn't previously (when parent directory doesn't exist).  The unit tests and the e2e tests of Pig will be broken after using a Hadoop with this patch.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220995#comment-13220995 ] 

Robert Joseph Evans commented on HADOOP-8131:
---------------------------------------------

>From a quick look at the code it mostly looks good.  I don't like the name.equals in the checking for a parent, but like the comment says there really is no other way I can think of to know if it is a directory or not, especially a directory that does not exist.

I also noticed some commented out code in the tests, and some calls to system.out.  Please remove the commented out code, and verify that call of the calls to System.out are what you want.  It might be better to change them to be log statements.

I will look at the logic more closely now.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238632#comment-13238632 ] 

Eli Collins commented on HADOOP-8131:
-------------------------------------

I like the new behavior as well, and I suppose an alpha is the best time to introduce it. How about updating this jira with a release note then?  We'll file a Pig to update the tests to work against 23.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221186#comment-13221186 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Common-0.23-Commit #629 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/629/])
    svn merge -c 1296386 trunk to branch-0.23 FIXES HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296389)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296389
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221003#comment-13221003 ] 

Hadoop QA commented on HADOOP-8131:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516846/HADOOP-8131.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.fs.viewfs.TestViewFsTrash
                  org.apache.hadoop.fs.TestFsShellReturnCode

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/657//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/657//console

This message is automatically generated.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238654#comment-13238654 ] 

Daryn Sharp commented on HADOOP-8131:
-------------------------------------

Just to confirm: you mean a real conf key, not a cmdline flag, right?  In either case it will be a "change now or change later" scenario.  I'm curious when would you anticipate a good time to remove a new & deprecated conf?  Would it live all the way through 23?  As Eli pointed out, an alpha may be the best time to remove the behavior.  Thoughts?
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Koji Noguchi (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238655#comment-13238655 ] 

Koji Noguchi commented on HADOOP-8131:
--------------------------------------

bq. I'd be in favor of a deprecated config flag which restores the old behavior 
Would this bring back the issue of left out _temporary dirs? (MAPREDUCE-1272)

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221180#comment-13221180 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #1821 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1821/])
    HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296386)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296386
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221176#comment-13221176 ] 

Hudson commented on HADOOP-8131:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1895 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1895/])
    HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby) (Revision 1296386)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296386
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CommandWithDestination.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/PathData.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellCopy.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShellReturnCode.java

                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans updated HADOOP-8131:
----------------------------------------

       Resolution: Fixed
    Fix Version/s: 0.23.2
           Status: Resolved  (was: Patch Available)

Thanks Daryn, I just commited this to trunk, branch-0.23 and branch-0.23.2
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221161#comment-13221161 ] 

Robert Joseph Evans commented on HADOOP-8131:
---------------------------------------------

Jenkins gave it a +1 and the code looks good to me +1.
                
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8131) FsShell put doesn't correctly handle a non-existent dir

Posted by "Daryn Sharp (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8131:
--------------------------------

    Status: Patch Available  (was: Open)
    
> FsShell put doesn't correctly handle a non-existent dir
> -------------------------------------------------------
>
>                 Key: HADOOP-8131
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8131
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>            Priority: Critical
>         Attachments: HADOOP-8131.patch, HADOOP-8131.patch
>
>
> {noformat}
> $ hadoop fs -ls
> ls: `.': No such file or directory
> $ hadoop fs -put file
> $ hadoop fs -ls
> Found 1 items
> -rw-r--r--   1 kihwal supergroup       2076 2011-11-04 10:37 .._COPYING_
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira