You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Alejandro Abdelnur (JIRA)" <ji...@apache.org> on 2011/06/21 19:29:49 UTC

[jira] [Created] (HDFS-2096) Mavenization of hadoop-hdfs

Mavenization of hadoop-hdfs
---------------------------

                 Key: HDFS-2096
                 URL: https://issues.apache.org/jira/browse/HDFS-2096
             Project: Hadoop HDFS
          Issue Type: Task
            Reporter: Alejandro Abdelnur


Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AG.patch
                HDFS-2096-AG.sh

'AG' script/patch, changes for test-patch & smart-apply-patch script to work with Mavenized HDFS

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082619#comment-13082619 ] 

Hadoop QA commented on HDFS-2096:
---------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12490016/HDFS-2096-AE.patch
  against trunk revision 1155998.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 59 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1073//console

This message is automatically generated.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155523#comment-13155523 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-2096:
----------------------------------------------

np, I will then put the WebHDFS apt doc under hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site for the moment.
                
> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AD.sh
                HDFS-2096-AD.patch

script/patch 'AD'

The only thing missing in the Maven build is wiring the native testcases.

Which (the native testcases) have been broken in trunk for a while, HDFS-2224.

Would it be OK to move forward with HDFS-2096 and then fix HDFS-2224 on top of Mavenized HDFS? (more than fix is implement the native test invocation).

What we also have to do is to make the test-patch script to work on commons or hdfs to run just the testcases of either commons or hdfs.


> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AJ.sh
                HDFS-2096-AJ.patch

version 'AJ' Rebased to trunk post MR279. It depends on HADOOP-7264.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AA.sh
                HDFS-2096-AA.patch

Preview (still a few things missing) 

Patch 'AA'

Patch instructions (Same as with HADOOP-6671):

* run the script on trunk/
* apply the patch on trunk/

Building instructions are the same as HADOOP-6671 (explained in trunk/BUILDING.txt).

* It build hdfs native.
* It runs the testcases (there are some failures I'm looking into) (see at the end of this comment).
* It creates docs & creates TARs with both legacy tar and new binary layouts.
* System/unit tests are not wired.
* Native tests are not wired.

Of course, it requires HADOOP-6671.

The build between common and hdfs is identical and it can be factored out (I'll do that as part of follow up JIRA onces things are stable).

I need some help for the following:

* Understanding how/when system/unit test are run.
* Understanding how native tests are setup/run.

For the latter I'd like to break it into another JIRA as it seems not that trivial and I'll need help.

Current testcases failures:

{code}
Running org.apache.hadoop.hdfs.TestHDFSServerPorts
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.483 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.blockmanagement.TestHost2NodesMap
Tests run: 4, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.792 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 138.615 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.common.TestDistributedUpgrade
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.247 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestBlocksWithNotEnoughRacks
Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 71.016 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestEditLogFileOutputStream
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 7.645 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage
Tests run: 3, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 0.965 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner
Tests run: 5, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 38.767 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.TestDecommission
Tests run: 7, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 151.665 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestStartup
Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 28.425 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.662 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.519 sec <<< FAILURE!
Running org.apache.hadoop.cli.TestHDFSCLI
Tests run: 2, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.169 sec <<< FAILURE!
{code}

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083295#comment-13083295 ] 

Hadoop QA commented on HDFS-2096:
---------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12490143/HDFS-2096-AF.patch
  against trunk revision 1156490.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 69 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1087//console

This message is automatically generated.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AF.patch
                HDFS-2096-AF.sh

ATM thanks for your feedback/findings.

'AF' version of script/patch fixes the issues you run into.

When testing, make sure to do a 'mvn install -DskipTests' from trunk/ before running mvn from trunk/hadoop-hdfs/ as there are changes in the other modules as well.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087839#comment-13087839 ] 

Hudson commented on HDFS-2096:
------------------------------

Integrated in Hadoop-Common-trunk-Commit #758 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/758/])
    HDFS-2096. Mavenization of hadoop-hdfs. Contributed by Alejandro Abdelnur.

tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1159702
Files : 
* /hadoop/common/trunk/hadoop-hdfs/src/main/native
* /hadoop/common/trunk/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/proto/DataTransferProtos.java
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data15bytes
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-template.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/test-patch.properties
* /hadoop/common/trunk/hadoop-hdfs/bin
* /hadoop/common/trunk/hadoop-hdfs/src/test/all-tests
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data15bytes
* /hadoop/common/trunk/hadoop-hdfs/src/main/xsl
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-instrumented-template.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/NameNode.launch
* /hadoop/common/trunk/hadoop-hdfs/dev-support/checkstyle.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/DataNode.launch
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
* /hadoop/common/trunk/hadoop-hdfs
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-14-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/src/test/hdfs/org
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/hadoop-22-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps/proto-hdfs-web.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/java
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-bintar.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/xsl/configuration.xsl
* /hadoop/common/trunk/hadoop-hdfs/ivy.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/hadoop-policy.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/ivysettings.xml
* /hadoop/common/trunk/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support
* /hadoop/common/trunk/hadoop-hdfs/build.xml
* /hadoop/common/trunk/hadoop-common/BUILDING.txt
* /hadoop/common/trunk/hadoop-hdfs/src/main/packages
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/empty-file
* /hadoop/common/trunk/hadoop-hdfs/src/test/log4j.properties
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/configuration.xsl
* /hadoop/common/trunk/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/src/webapps
* /hadoop/common/trunk/dev-support/smart-apply-patch.sh
* /hadoop/common/trunk/BUILDING.txt
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/SpecificTestTemplate.launch
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/resources
* /hadoop/common/trunk/hadoop-hdfs/dev-support/checkstyle-noframes-sorted.xsl
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data120bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data1k
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineEditsViewer/editsStored
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/hadoop-dfs-dir.txt
* /hadoop/common/trunk/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/fsimageV18
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-policy.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/java/hdfs-default.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/fsimageV19
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-22-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/ivy/libraries.properties
* /hadoop/common/trunk/hdfs
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data60bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data60bytes
* /hadoop/common/trunk/hadoop-hdfs/src/java
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/native/c++/libhdfs
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/hdfs-site.xml.template
* /hadoop/common/trunk/hadoop-hdfs/src/main/packages/templates/conf/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/README.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-test-template.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/bin
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/log4j.properties
* /hadoop/common/trunk/hadoop-hdfs/src/test/checkstyle.xml
* /hadoop/common/trunk/hadoop-project-distro/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support/commit-tests
* /hadoop/common/trunk/hadoop-hdfs/src/main
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineEditsViewer/editsStored.xml
* /hadoop/common/trunk/hadoop-hdfs/src/docs
* /hadoop/common/trunk/hadoop-hdfs/dev-support/smoke-tests
* /hadoop/common/trunk/hadoop-hdfs/src/test/fi-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/java
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs/dev-support/findbugsExcludeFile.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/editsStored
* /hadoop/common/trunk/hadoop-hdfs/src/test/checkstyle-noframes-sorted.xsl
* /hadoop/common/trunk/hadoop-hdfs/src/test/smoke-tests
* /hadoop/common/trunk/hadoop-hdfs/src/c++
* /hadoop/common/trunk/hadoop-hdfs/src/test/findbugsExcludeFile.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-instrumented-test-template.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/AllTests.launch
* /hadoop/common/trunk/hadoop-project-distro
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data1k
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data120bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/fi-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/testHDFSConf.xml
* /hadoop/common/trunk/hadoop-hdfs/lib/jdiff
* /hadoop/common/trunk/hadoop-hdfs/src/main/docs
* /hadoop/common/trunk/hadoop-project-distro/README.txt
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-dfs-dir.txt
* /hadoop/common/trunk/hadoop-hdfs/conf
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs/src/test/krb5.conf
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/testHDFSConf.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data30bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/fsimageV18
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/fsimageV19
* /hadoop/common/trunk/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/proto/HdfsProtos.java
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data30bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/empty-file
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps/proto-secondary-web.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/hadoop-14-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps/proto-datanode-web.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/native/c++
* /hadoop/common/trunk/hadoop-hdfs/dev-support/jdiff
* /hadoop/common/trunk/hadoop-hdfs/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/.gitignore
* /hadoop/common/trunk/hadoop-hdfs/src/main/resources/hdfs-default.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support/test-patch.properties
* /hadoop/common/trunk/hadoop-hdfs/src/packages
* /hadoop/common/trunk/hadoop-hdfs/src/test/commit-tests
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/editsStored.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support/all-tests
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/krb5.conf


> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AH.patch
                HDFS-2096-AH.sh

'AH' version of script/patch.

Fixes issue with some testcases (ie TestHDFSServerPorts) where the test data directory is resolved to '/test/..' instead inside the build directory.

The reason is that the 'hadoop.tmp.dir' sys prop was not being set up for testcases.


> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155424#comment-13155424 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-2096:
----------------------------------------------

Hi Alejandro,

Where should the HDFS apt doc go?
                
> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155435#comment-13155435 ] 

Alejandro Abdelnur commented on HDFS-2096:
------------------------------------------

same dir structure of hadoop-common-project/hadoop-auth APT (src/site/...) under hadoop-hdfs-project/hadoop-hdfs
                
> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AE.patch
                HDFS-2096-AE.sh

'AE' version of script/patch, work on current trunk HEAD (revision 1156215)

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155459#comment-13155459 ] 

Tsz Wo (Nicholas), SZE commented on HDFS-2096:
----------------------------------------------

But the directory hadoop-hdfs-project/hadoop-hdfs/src/site is not found.

Also, "mvn site" failed if it is executed under hadoop-hdfs-project/hadoop-hdfs.
                
> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083334#comment-13083334 ] 

Hadoop QA commented on HDFS-2096:
---------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12490146/HDFS-2096-AG.patch
  against trunk revision 1156490.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 68 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1088//console

This message is automatically generated.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HDFS-2096:
----------------------------

       Resolution: Fixed
    Fix Version/s: 0.23.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I committed this. Thanks, Alejandro!

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AC.sh
                HDFS-2096-AC.patch

script/patch version 'AC'.

It is fully functional and the packaging is complete as well (it is shared with hadoop-common).

The only missing part are the native testcases.

It introduces a new Maven module, hadoop-project-distro. This module is the parent of hadoop-common & hadoop-distro and all common build instructions are in that POM (forrest, findbugs, checkstyle and TAR packaging).

It also adds Apache Maven2 SNAPSHOTs repo to the hadoop-project POM. This allows to build from any module level using published snapshot versions for the modules that are not being built.



> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur reassigned HDFS-2096:
----------------------------------------

    Assignee: Alejandro Abdelnur

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AI.patch
                HDFS-2096-AI.sh

Rebasing to current trunk

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083533#comment-13083533 ] 

Aaron T. Myers commented on HDFS-2096:
--------------------------------------

Thanks a lot for fixing those issues, Alejandro. I re-ran all the tests I ran last night and everything worked great.

Additionally, I tried out test-patch.sh, which seemed to work flawlessly.

+1, patch looks good to me.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081272#comment-13081272 ] 

Eli Collins commented on HDFS-2096:
-----------------------------------

Yea, let's move forward with this jira and fix HDFS-2224 post mavenization.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tom White (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13079650#comment-13079650 ] 

Tom White commented on HDFS-2096:
---------------------------------

Does this include changes for running test-patch?

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082577#comment-13082577 ] 

Hadoop QA commented on HDFS-2096:
---------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12490016/HDFS-2096-AE.patch
  against trunk revision 1155998.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 59 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1068//console

This message is automatically generated.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083006#comment-13083006 ] 

Aaron T. Myers commented on HDFS-2096:
--------------------------------------

Hey Alejandro, I gave this patch a try and almost everything looked great.

I tried the following with great success:

# Importing the projects into Eclipse. Worked flawlessly except for the known issue with generated sources. (BTW, the instructions on the wiki are slightly off. I had to add the directory "{{target/generated-src/test/java}}", not "{{target/generated-test-sources/java}}" as are in the instructions.)
# Clean/compile the project from trunk/
# Clean/compile the project from trunk/hdfs
# Run a single unit test
# Run the full suite of unit tests
# Building a plain TAR
# Running findbugs

The following, however, did not work:

# Though the RAT check runs just fine, HDFS fails because of "Too many unapproved licenses: 57". I think a few more directories need to be excluded.
# Running checkstyle. I ran {{`mvn compile checkstyle:checkstyle'}} as instrucuted, which failed with the following error:
\\
{noformat}
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.6:checkstyle (default-cli) on project hadoop-hdfs: An error has occurred in Checkstyle report generation. Failed during checkstyle configuration: cannot initialize module PackageHtml - Unable to instantiate PackageHtml: Unable to instantiate PackageHtmlCheck -> [Help 1]
{noformat}
\\
# Building a TAR with the native libs. I ran the following from trunk/hadoop-hdfs: {{mvn -DskipTests -Pnative package}}. This failed with the following error:

{noformat}
[INFO] --- make-maven-plugin:1.0-beta-1:test (test) @ hadoop-hdfs ---
[INFO] make: *** No rule to make target `check'.  Stop.
{noformat}

Somewhat curiously, simply compiling the native libs ({{`mvn -Pnative compile'}}) appears to work.

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087348#comment-13087348 ] 

Eric Yang commented on HDFS-2096:
---------------------------------

+1 

(ignoring unit test failure in HADOOP-7264)

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Status: Patch Available  (was: Open)

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HDFS-2096:
-----------------------------------------

    Component/s: build

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155467#comment-13155467 ] 

Alejandro Abdelnur commented on HDFS-2096:
------------------------------------------

Sorry, I should have been a bit more clear, it has to be done, mvn site & APT is not wired in hdfs yet, it has to be done.
                
> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HDFS-2096:
-------------------------------------

    Attachment: HDFS-2096-AB.sh
                HDFS-2096-AB.patch

script/patch set 'AB'

All testcases passing.

Missing

* wiring test-patch script for HDFS.
* the AOP tests (another JIRA)
* contrib (another JIRA)

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs

Posted by "Tom White (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084241#comment-13084241 ] 

Tom White commented on HDFS-2096:
---------------------------------

+1

I tried various mvn goals, ran test-patch.sh on an example patch, and built MR against Common and HDFS jars built by Maven.

So I think this is ready to go in - we could do this today (Friday), or wait until Monday if folks think that is better. In terms of migration, I plan to write a patch migration script (like the one in HADOOP-7500 for Common), we'll also need switch over the Jenkins jobs to use Maven (just like Giri and I did for Common).

> Mavenization of hadoop-hdfs
> ---------------------------
>
>                 Key: HDFS-2096
>                 URL: https://issues.apache.org/jira/browse/HDFS-2096
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: build
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>         Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh
>
>
> Same as HADOOP-6671 for hdfs

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira