You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Alejandro Abdelnur (JIRA)" <ji...@apache.org> on 2011/06/21 19:29:49 UTC
[jira] [Created] (HDFS-2096) Mavenization of hadoop-hdfs
Mavenization of hadoop-hdfs
---------------------------
Key: HDFS-2096
URL: https://issues.apache.org/jira/browse/HDFS-2096
Project: Hadoop HDFS
Issue Type: Task
Reporter: Alejandro Abdelnur
Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AG.patch
HDFS-2096-AG.sh
'AG' script/patch, changes for test-patch & smart-apply-patch script to work with Mavenized HDFS
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082619#comment-13082619 ]
Hadoop QA commented on HDFS-2096:
---------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12490016/HDFS-2096-AE.patch
against trunk revision 1155998.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 59 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1073//console
This message is automatically generated.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155523#comment-13155523 ]
Tsz Wo (Nicholas), SZE commented on HDFS-2096:
----------------------------------------------
np, I will then put the WebHDFS apt doc under hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site for the moment.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: 0.23.0
>
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AD.sh
HDFS-2096-AD.patch
script/patch 'AD'
The only thing missing in the Maven build is wiring the native testcases.
Which (the native testcases) have been broken in trunk for a while, HDFS-2224.
Would it be OK to move forward with HDFS-2096 and then fix HDFS-2224 on top of Mavenized HDFS? (more than fix is implement the native test invocation).
What we also have to do is to make the test-patch script to work on commons or hdfs to run just the testcases of either commons or hdfs.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AJ.sh
HDFS-2096-AJ.patch
version 'AJ' Rebased to trunk post MR279. It depends on HADOOP-7264.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AA.sh
HDFS-2096-AA.patch
Preview (still a few things missing)
Patch 'AA'
Patch instructions (Same as with HADOOP-6671):
* run the script on trunk/
* apply the patch on trunk/
Building instructions are the same as HADOOP-6671 (explained in trunk/BUILDING.txt).
* It build hdfs native.
* It runs the testcases (there are some failures I'm looking into) (see at the end of this comment).
* It creates docs & creates TARs with both legacy tar and new binary layouts.
* System/unit tests are not wired.
* Native tests are not wired.
Of course, it requires HADOOP-6671.
The build between common and hdfs is identical and it can be factored out (I'll do that as part of follow up JIRA onces things are stable).
I need some help for the following:
* Understanding how/when system/unit test are run.
* Understanding how native tests are setup/run.
For the latter I'd like to break it into another JIRA as it seems not that trivial and I'll need help.
Current testcases failures:
{code}
Running org.apache.hadoop.hdfs.TestHDFSServerPorts
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.483 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.blockmanagement.TestHost2NodesMap
Tests run: 4, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.792 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestCheckpoint
Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 138.615 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.common.TestDistributedUpgrade
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.247 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestBlocksWithNotEnoughRacks
Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 71.016 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestEditLogFileOutputStream
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 7.645 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage
Tests run: 3, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 0.965 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner
Tests run: 5, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 38.767 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.TestDecommission
Tests run: 7, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 151.665 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestStartup
Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 28.425 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.662 sec <<< FAILURE!
Running org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.519 sec <<< FAILURE!
Running org.apache.hadoop.cli.TestHDFSCLI
Tests run: 2, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.169 sec <<< FAILURE!
{code}
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083295#comment-13083295 ]
Hadoop QA commented on HDFS-2096:
---------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12490143/HDFS-2096-AF.patch
against trunk revision 1156490.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 69 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1087//console
This message is automatically generated.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AF.patch
HDFS-2096-AF.sh
ATM thanks for your feedback/findings.
'AF' version of script/patch fixes the issues you run into.
When testing, make sure to do a 'mvn install -DskipTests' from trunk/ before running mvn from trunk/hadoop-hdfs/ as there are changes in the other modules as well.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087839#comment-13087839 ]
Hudson commented on HDFS-2096:
------------------------------
Integrated in Hadoop-Common-trunk-Commit #758 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/758/])
HDFS-2096. Mavenization of hadoop-hdfs. Contributed by Alejandro Abdelnur.
tomwhite : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1159702
Files :
* /hadoop/common/trunk/hadoop-hdfs/src/main/native
* /hadoop/common/trunk/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/proto/DataTransferProtos.java
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data15bytes
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-tar.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-template.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/test-patch.properties
* /hadoop/common/trunk/hadoop-hdfs/bin
* /hadoop/common/trunk/hadoop-hdfs/src/test/all-tests
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data15bytes
* /hadoop/common/trunk/hadoop-hdfs/src/main/xsl
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-instrumented-template.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/NameNode.launch
* /hadoop/common/trunk/hadoop-hdfs/dev-support/checkstyle.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/DataNode.launch
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
* /hadoop/common/trunk/hadoop-hdfs
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-14-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/src/test/hdfs/org
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/hadoop-22-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps/proto-hdfs-web.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/java
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-bintar.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/xsl/configuration.xsl
* /hadoop/common/trunk/hadoop-hdfs/ivy.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/hadoop-policy.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/ivysettings.xml
* /hadoop/common/trunk/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support
* /hadoop/common/trunk/hadoop-hdfs/build.xml
* /hadoop/common/trunk/hadoop-common/BUILDING.txt
* /hadoop/common/trunk/hadoop-hdfs/src/main/packages
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/empty-file
* /hadoop/common/trunk/hadoop-hdfs/src/test/log4j.properties
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/configuration.xsl
* /hadoop/common/trunk/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/src/webapps
* /hadoop/common/trunk/dev-support/smart-apply-patch.sh
* /hadoop/common/trunk/BUILDING.txt
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/SpecificTestTemplate.launch
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/resources
* /hadoop/common/trunk/hadoop-hdfs/dev-support/checkstyle-noframes-sorted.xsl
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data120bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data1k
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineEditsViewer/editsStored
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/hadoop-dfs-dir.txt
* /hadoop/common/trunk/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/fsimageV18
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-policy.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/java/hdfs-default.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/fsimageV19
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-22-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/ivy/libraries.properties
* /hadoop/common/trunk/hdfs
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data60bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data60bytes
* /hadoop/common/trunk/hadoop-hdfs/src/java
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/native/c++/libhdfs
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf/hdfs-site.xml.template
* /hadoop/common/trunk/hadoop-hdfs/src/main/packages/templates/conf/hdfs-site.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/README.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-test-template.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/bin
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/log4j.properties
* /hadoop/common/trunk/hadoop-hdfs/src/test/checkstyle.xml
* /hadoop/common/trunk/hadoop-project-distro/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support/commit-tests
* /hadoop/common/trunk/hadoop-hdfs/src/main
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineEditsViewer/editsStored.xml
* /hadoop/common/trunk/hadoop-hdfs/src/docs
* /hadoop/common/trunk/hadoop-hdfs/dev-support/smoke-tests
* /hadoop/common/trunk/hadoop-hdfs/src/test/fi-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/java
* /hadoop/common/trunk/hadoop-hdfs/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs/dev-support/findbugsExcludeFile.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/editsStored
* /hadoop/common/trunk/hadoop-hdfs/src/test/checkstyle-noframes-sorted.xsl
* /hadoop/common/trunk/hadoop-hdfs/src/test/smoke-tests
* /hadoop/common/trunk/hadoop-hdfs/src/c++
* /hadoop/common/trunk/hadoop-hdfs/src/test/findbugsExcludeFile.xml
* /hadoop/common/trunk/hadoop-hdfs/ivy/hadoop-hdfs-instrumented-test-template.xml
* /hadoop/common/trunk/hadoop-hdfs/.eclipse.templates/.launches/AllTests.launch
* /hadoop/common/trunk/hadoop-project-distro
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data1k
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data120bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/fi-site.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/testHDFSConf.xml
* /hadoop/common/trunk/hadoop-hdfs/lib/jdiff
* /hadoop/common/trunk/hadoop-hdfs/src/main/docs
* /hadoop/common/trunk/hadoop-project-distro/README.txt
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/hadoop-dfs-dir.txt
* /hadoop/common/trunk/hadoop-hdfs/conf
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs/src/test/krb5.conf
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/testHDFSConf.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/data30bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/fsimageV18
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/fsimageV19
* /hadoop/common/trunk/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/proto/HdfsProtos.java
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/clitest_data/data30bytes
* /hadoop/common/trunk/hadoop-hdfs/src/test/empty-file
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps/proto-secondary-web.xml
* /hadoop/common/trunk/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/hadoop-14-dfs-dir.tgz
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps/proto-datanode-web.xml
* /hadoop/common/trunk/hadoop-hdfs/src/main/native/c++
* /hadoop/common/trunk/hadoop-hdfs/dev-support/jdiff
* /hadoop/common/trunk/hadoop-hdfs/pom.xml
* /hadoop/common/trunk/hadoop-hdfs/.gitignore
* /hadoop/common/trunk/hadoop-hdfs/src/main/resources/hdfs-default.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support/test-patch.properties
* /hadoop/common/trunk/hadoop-hdfs/src/packages
* /hadoop/common/trunk/hadoop-hdfs/src/test/commit-tests
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/editsStored.xml
* /hadoop/common/trunk/hadoop-hdfs/dev-support/all-tests
* /hadoop/common/trunk/hadoop-hdfs/src/main/webapps
* /hadoop/common/trunk/hadoop-hdfs/src/test/resources/krb5.conf
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AH.patch
HDFS-2096-AH.sh
'AH' version of script/patch.
Fixes issue with some testcases (ie TestHDFSServerPorts) where the test data directory is resolved to '/test/..' instead inside the build directory.
The reason is that the 'hadoop.tmp.dir' sys prop was not being set up for testcases.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155424#comment-13155424 ]
Tsz Wo (Nicholas), SZE commented on HDFS-2096:
----------------------------------------------
Hi Alejandro,
Where should the HDFS apt doc go?
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: 0.23.0
>
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155435#comment-13155435 ]
Alejandro Abdelnur commented on HDFS-2096:
------------------------------------------
same dir structure of hadoop-common-project/hadoop-auth APT (src/site/...) under hadoop-hdfs-project/hadoop-hdfs
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: 0.23.0
>
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AE.patch
HDFS-2096-AE.sh
'AE' version of script/patch, work on current trunk HEAD (revision 1156215)
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155459#comment-13155459 ]
Tsz Wo (Nicholas), SZE commented on HDFS-2096:
----------------------------------------------
But the directory hadoop-hdfs-project/hadoop-hdfs/src/site is not found.
Also, "mvn site" failed if it is executed under hadoop-hdfs-project/hadoop-hdfs.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: 0.23.0
>
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083334#comment-13083334 ]
Hadoop QA commented on HDFS-2096:
---------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12490146/HDFS-2096-AG.patch
against trunk revision 1156490.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 68 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1088//console
This message is automatically generated.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HDFS-2096:
----------------------------
Resolution: Fixed
Fix Version/s: 0.23.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I committed this. Thanks, Alejandro!
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: 0.23.0
>
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AC.sh
HDFS-2096-AC.patch
script/patch version 'AC'.
It is fully functional and the packaging is complete as well (it is shared with hadoop-common).
The only missing part are the native testcases.
It introduces a new Maven module, hadoop-project-distro. This module is the parent of hadoop-common & hadoop-distro and all common build instructions are in that POM (forrest, findbugs, checkstyle and TAR packaging).
It also adds Apache Maven2 SNAPSHOTs repo to the hadoop-project POM. This allows to build from any module level using published snapshot versions for the modules that are not being built.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur reassigned HDFS-2096:
----------------------------------------
Assignee: Alejandro Abdelnur
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AI.patch
HDFS-2096-AI.sh
Rebasing to current trunk
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083533#comment-13083533 ]
Aaron T. Myers commented on HDFS-2096:
--------------------------------------
Thanks a lot for fixing those issues, Alejandro. I re-ran all the tests I ran last night and everything worked great.
Additionally, I tried out test-patch.sh, which seemed to work flawlessly.
+1, patch looks good to me.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081272#comment-13081272 ]
Eli Collins commented on HDFS-2096:
-----------------------------------
Yea, let's move forward with this jira and fix HDFS-2224 post mavenization.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13079650#comment-13079650 ]
Tom White commented on HDFS-2096:
---------------------------------
Does this include changes for running test-patch?
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082577#comment-13082577 ]
Hadoop QA commented on HDFS-2096:
---------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12490016/HDFS-2096-AE.patch
against trunk revision 1155998.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 59 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1068//console
This message is automatically generated.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083006#comment-13083006 ]
Aaron T. Myers commented on HDFS-2096:
--------------------------------------
Hey Alejandro, I gave this patch a try and almost everything looked great.
I tried the following with great success:
# Importing the projects into Eclipse. Worked flawlessly except for the known issue with generated sources. (BTW, the instructions on the wiki are slightly off. I had to add the directory "{{target/generated-src/test/java}}", not "{{target/generated-test-sources/java}}" as are in the instructions.)
# Clean/compile the project from trunk/
# Clean/compile the project from trunk/hdfs
# Run a single unit test
# Run the full suite of unit tests
# Building a plain TAR
# Running findbugs
The following, however, did not work:
# Though the RAT check runs just fine, HDFS fails because of "Too many unapproved licenses: 57". I think a few more directories need to be excluded.
# Running checkstyle. I ran {{`mvn compile checkstyle:checkstyle'}} as instrucuted, which failed with the following error:
\\
{noformat}
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.6:checkstyle (default-cli) on project hadoop-hdfs: An error has occurred in Checkstyle report generation. Failed during checkstyle configuration: cannot initialize module PackageHtml - Unable to instantiate PackageHtml: Unable to instantiate PackageHtmlCheck -> [Help 1]
{noformat}
\\
# Building a TAR with the native libs. I ran the following from trunk/hadoop-hdfs: {{mvn -DskipTests -Pnative package}}. This failed with the following error:
{noformat}
[INFO] --- make-maven-plugin:1.0-beta-1:test (test) @ hadoop-hdfs ---
[INFO] make: *** No rule to make target `check'. Stop.
{noformat}
Somewhat curiously, simply compiling the native libs ({{`mvn -Pnative compile'}}) appears to work.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087348#comment-13087348 ]
Eric Yang commented on HDFS-2096:
---------------------------------
+1
(ignoring unit test failure in HADOOP-7264)
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Status: Patch Available (was: Open)
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HDFS-2096:
-----------------------------------------
Component/s: build
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155467#comment-13155467 ]
Alejandro Abdelnur commented on HDFS-2096:
------------------------------------------
Sorry, I should have been a bit more clear, it has to be done, mvn site & APT is not wired in hdfs yet, it has to be done.
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: 0.23.0
>
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh, HDFS-2096-AI.patch, HDFS-2096-AI.sh, HDFS-2096-AJ.patch, HDFS-2096-AJ.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HDFS-2096:
-------------------------------------
Attachment: HDFS-2096-AB.sh
HDFS-2096-AB.patch
script/patch set 'AB'
All testcases passing.
Missing
* wiring test-patch script for HDFS.
* the AOP tests (another JIRA)
* contrib (another JIRA)
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2096) Mavenization of hadoop-hdfs
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084241#comment-13084241 ]
Tom White commented on HDFS-2096:
---------------------------------
+1
I tried various mvn goals, ran test-patch.sh on an example patch, and built MR against Common and HDFS jars built by Maven.
So I think this is ready to go in - we could do this today (Friday), or wait until Monday if folks think that is better. In terms of migration, I plan to write a patch migration script (like the one in HADOOP-7500 for Common), we'll also need switch over the Jenkins jobs to use Maven (just like Giri and I did for Common).
> Mavenization of hadoop-hdfs
> ---------------------------
>
> Key: HDFS-2096
> URL: https://issues.apache.org/jira/browse/HDFS-2096
> Project: Hadoop HDFS
> Issue Type: Task
> Components: build
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Attachments: HDFS-2096-AA.patch, HDFS-2096-AA.sh, HDFS-2096-AB.patch, HDFS-2096-AB.sh, HDFS-2096-AC.patch, HDFS-2096-AC.sh, HDFS-2096-AD.patch, HDFS-2096-AD.sh, HDFS-2096-AE.patch, HDFS-2096-AE.sh, HDFS-2096-AF.patch, HDFS-2096-AF.sh, HDFS-2096-AG.patch, HDFS-2096-AG.sh, HDFS-2096-AH.patch, HDFS-2096-AH.sh
>
>
> Same as HADOOP-6671 for hdfs
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira