You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2012/07/03 15:55:24 UTC

[jira] [Created] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Robert Joseph Evans created HADOOP-8551:
-------------------------------------------

             Summary: fs -mkdir creates parent directories without the -p option
                 Key: HADOOP-8551
                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs
    Affects Versions: 0.23.3, 2.0.1-alpha, 3.0.0
            Reporter: Robert Joseph Evans
            Assignee: Daryn Sharp


hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418725#comment-13418725 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #2524 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2524/])
    Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option (Revision 1363547)

     Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363547
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419161#comment-13419161 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #1142 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1142/])
    Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option (Revision 1363547)
HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) (Revision 1363435)

     Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363547
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363435
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418482#comment-13418482 ] 

Hadoop QA commented on HADOOP-8551:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12537196/HADOOP-8551.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 1 new or modified test files.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1207//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1207//console

This message is automatically generated.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421802#comment-13421802 ] 

Hadoop QA commented on HADOOP-8551:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12537732/HADOOP-8551.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 1 new or modified test files.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

                  org.apache.hadoop.ha.TestZKFailoverController
                  org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
                  org.apache.hadoop.hdfs.TestPersistBlocks

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1214//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1214//console

This message is automatically generated.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "John George (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John George reassigned HADOOP-8551:
-----------------------------------

    Assignee: John George  (was: Daryn Sharp)
    
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463025#comment-13463025 ] 

Suresh Srinivas commented on HADOOP-8551:
-----------------------------------------

This is an incompatible change right?
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418502#comment-13418502 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #2564 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2564/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) (Revision 1363435)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363435
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Comment Edited] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463132#comment-13463132 ] 

Suresh Srinivas edited comment on HADOOP-8551 at 9/26/12 6:28 AM:
------------------------------------------------------------------

We should update the release notes to indicate that this is incompatible change. Please add in release notes what details about incompatibility and how to work around it. Also we need to move this change description to incompatible section in CHANGES.txt.

Does this not cause issues at Yahoo?
                
      was (Author: sureshms):
    We should update the release notes to indicate that this is incompatible change. Please add in release notes what details about incompatibility and how to work around it. Also we need to move this change description to incompatible section.

Does this not cause issues at Yahoo?
                  
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans updated HADOOP-8551:
----------------------------------------

    Attachment: HADOOP-8551.patch
    
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465266#comment-13465266 ] 

Eli Collins commented on HADOOP-8551:
-------------------------------------

bq. If it's too much of a problem to s/mkdir /mkdir -p /

Just replacing mkdir with "mkdir -p" doesn't fix things because Hadoop 1.x doesn't support the "-p" option so if you just add "-p" everywhere your programs break on old releases. I'm surprised you haven't hit this trying to deploy 0.23.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans updated HADOOP-8551:
----------------------------------------

       Resolution: Fixed
    Fix Version/s: 2.2.0-alpha
                   3.0.0
                   0.23.3
           Status: Resolved  (was: Patch Available)

Thanks John and Daryn.  I put this into trunk, branch-2, and branch-0.23
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422288#comment-13422288 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #2519 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2519/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) (Revision 1365588)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1365588
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8551:
--------------------------------

    Attachment: HADOOP-8551.patch

This should fix it, but need to write tests.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.1-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>         Attachments: HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Reopened] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans reopened HADOOP-8551:
-----------------------------------------


-mkdir a
-mkdir a/b/ (Fails)
-mkdir a/b (Succeeds)

I am going to revert this until this is fixed, thanks for catching this John.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464438#comment-13464438 ] 

Eli Collins commented on HADOOP-8551:
-------------------------------------

I think it's actually worth considering reverting this from branch-2 and having a warning there about it being deprecated in 2.x. I reverted this change from CDH because it broke some many internal users and tests.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465605#comment-13465605 ] 

Daryn Sharp commented on HADOOP-8551:
-------------------------------------

Our customers all updated their jobs.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "John George (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421815#comment-13421815 ] 

John George commented on HADOOP-8551:
-------------------------------------

The test failures are unrelated. They seem to be failing in other builds as well
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418708#comment-13418708 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #2503 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2503/])
    Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option (Revision 1363547)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363547
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421645#comment-13421645 ] 

Robert Joseph Evans commented on HADOOP-8551:
---------------------------------------------

The patch looks good to me.  It is a little ugly, but I cannot think of a better way to strip off the trailing /.  +1 pending Jenkins, which still has not come back.  I'll try and kick it again.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HADOOP-8551:
--------------------------------

    Release Note: FsShell's "mkdir" no longer implicitly creates all non-existent parent directories.  The command adopts the posix compliant behavior of requiring the "-p" flag to auto-create parent directories.

No, this doesn't affect yahoo.  Our customers have already updated their jobs that require multi-level directory creation.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418511#comment-13418511 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #2521 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2521/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) (Revision 1363435)

     Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363435
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418507#comment-13418507 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #2499 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2499/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) (Revision 1363435)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363435
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418488#comment-13418488 ] 

Robert Joseph Evans commented on HADOOP-8551:
---------------------------------------------

The change looks good to me +1. I'll check it in.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423039#comment-13423039 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #1116 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1116/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) (Revision 1365588)

     Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1365588
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "John George (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John George updated HADOOP-8551:
--------------------------------

    Attachment: HADOOP-8551.patch
    
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans updated HADOOP-8551:
----------------------------------------

    Status: Patch Available  (was: Reopened)

Kicking Jenkins
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463132#comment-13463132 ] 

Suresh Srinivas commented on HADOOP-8551:
-----------------------------------------

We should update the release notes to indicate that this is incompatible change. Please add in release notes what details about incompatibility and how to work around it. Also we need to move this change description to incompatible section.

Does this not cause issues at Yahoo?
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467963#comment-13467963 ] 

Arun C Murthy commented on HADOOP-8551:
---------------------------------------

A major boundary (2.x) seems like the right time to 'fix' this.

Eli - we could add 'mkdir -p' to branch-1 too.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Closed] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy closed HADOOP-8551.
---------------------------------

    
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "John George (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John George updated HADOOP-8551:
--------------------------------

    Status: Patch Available  (was: Open)
    
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423088#comment-13423088 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #1148 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1148/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) (Revision 1365588)

     Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1365588
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464761#comment-13464761 ] 

Daryn Sharp commented on HADOOP-8551:
-------------------------------------

By adopting better posix compliance, there are a number of other "incompatible" changes in the shell.  Such as nothing auto-magically creates parent dirs anymore.  It was an oversight that mkdir did since the -p flag was there.  It seems like a minor change for users to add "-p", but that's just my $.02.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465022#comment-13465022 ] 

Robert Joseph Evans commented on HADOOP-8551:
---------------------------------------------

please no new config.  I know you don't want to revert this, but a config is not going to make it any easier to get people off of the old behavior, it will just give them a crutch they they will start to rely on.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suresh Srinivas updated HADOOP-8551:
------------------------------------

    Hadoop Flags: Incompatible change

Checked the Incompatible change checkbox. 
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464882#comment-13464882 ] 

Eli Collins commented on HADOOP-8551:
-------------------------------------

That's what I thought as well, however w/in a couple week of pulling it in there were enough tests/programs failing and people complaining that I reverted it. Apparently a lot of people depend on this behavior. People have been fine with all the other incompatible shell changes, have left all those in.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463339#comment-13463339 ] 

Suresh Srinivas commented on HADOOP-8551:
-----------------------------------------

bq. Also we need to move the change description of this jira to incompatible section in CHANGES.txt.
Can you please take care of this as well for all the relevant releases?
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423034#comment-13423034 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #325 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/325/])
    svn merge -c 1365588 FIXES: HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) (Revision 1365590)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1365590
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464939#comment-13464939 ] 

Robert Joseph Evans commented on HADOOP-8551:
---------------------------------------------

If the community feels that it should be reverted in branch-2 then I am fine with reverting it in branch-0.23 as well.  We just want to be sure that there is a deprecation warning, and preferably that it only prints out when a -p would be required in the future, but was not given.  
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Comment Edited] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463132#comment-13463132 ] 

Suresh Srinivas edited comment on HADOOP-8551 at 9/26/12 6:59 AM:
------------------------------------------------------------------

We should update the release notes to indicate that this is an incompatible change. Please add in release notes details about incompatibility and how to work around it. Also we need to move the change description of this jira to incompatible section in CHANGES.txt.

Does this not cause issues at Yahoo?
                
      was (Author: sureshms):
    We should update the release notes to indicate that this is incompatible change. Please add in release notes what details about incompatibility and how to work around it. Also we need to move this change description to incompatible section in CHANGES.txt.

Does this not cause issues at Yahoo?
                  
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463130#comment-13463130 ] 

Daryn Sharp commented on HADOOP-8551:
-------------------------------------

Yes.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422287#comment-13422287 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #2584 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2584/])
    HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) (Revision 1365588)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1365588
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422272#comment-13422272 ] 

Robert Joseph Evans commented on HADOOP-8551:
---------------------------------------------

Yes I have seen them failing in other builds +1.  I'll check this in.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "John George (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421729#comment-13421729 ] 

John George commented on HADOOP-8551:
-------------------------------------

-1 overall.  

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 41 new or modified tests.

    -1 javadoc.  The javadoc tool appears to have generated 16 warning messages.

    -1 javac.  The patch appears to cause tar ant target to fail.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    -1 findbugs.  The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419094#comment-13419094 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #319 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/319/])
    Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option (Revision 1363550)
svn merge -c 1363435 FIXES: HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby) (Revision 1363438)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363550
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363438
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464955#comment-13464955 ] 

Daryn Sharp commented on HADOOP-8551:
-------------------------------------

If it's too much of a problem to s/mkdir /mkdir -p /, rather than reverting I'd suggest a config option (I know, I know) that in generally can be used to enable/disable deprecated behavior in the shell.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans updated HADOOP-8551:
----------------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Thanks John,

I put this into trunk, branch-2, and branch-0.23 again.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421694#comment-13421694 ] 

Robert Joseph Evans commented on HADOOP-8551:
---------------------------------------------

John, The Jenkins build for this keeps getting aborted.  Could you run test-patch yourself?
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466035#comment-13466035 ] 

Eli Collins commented on HADOOP-8551:
-------------------------------------

And I guess those jobs will never run on older 205 clusters. We have to worry about jobs (and tests) that run on multiple versions and didn't want to require people update their jobs (most of the other shell changes that were incompatible didn't actually require people update their jobs).
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "John George (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John George updated HADOOP-8551:
--------------------------------

    Attachment: HADOOP-8551.patch

Attaching a new patch with the fix. Also added a new test to verify mkdir a/b/ works when dir 'a' exists.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418698#comment-13418698 ] 

Hudson commented on HADOOP-8551:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #2568 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2568/])
    Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option (Revision 1363547)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363547
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Mkdir.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testHDFSConf.xml

                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.1.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: Daryn Sharp
>             Fix For: 0.23.3, 3.0.0, 2.2.0-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8551) fs -mkdir creates parent directories without the -p option

Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465026#comment-13465026 ] 

Daryn Sharp commented on HADOOP-8551:
-------------------------------------

We'll disable and mark it final so they can't use deprecated behavior. ;)  Cloudera won't.
                
> fs -mkdir creates parent directories without the -p option
> ----------------------------------------------------------
>
>                 Key: HADOOP-8551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8551
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.23.3, 2.0.0-alpha, 3.0.0
>            Reporter: Robert Joseph Evans
>            Assignee: John George
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch, HADOOP-8551.patch
>
>
> hadoop fs -mkdir foo/bar will work even if bar is not present.  It should only work if -p is given and foo is not present.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira