You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Scott Chen (Created) (JIRA)" <ji...@apache.org> on 2012/02/16 01:45:00 UTC
[jira] [Created] (MAPREDUCE-3868) Reenable Raid
Reenable Raid
-------------
Key: MAPREDUCE-3868
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: contrib/raid
Reporter: Scott Chen
Assignee: Ramkumar Vadali
Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295999#comment-13295999 ]
Scott Chen commented on MAPREDUCE-3868:
---------------------------------------
There are compilation failures
{code}
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:59.229s
[INFO] Finished at: Fri Jun 15 16:03:11 PDT 2012
[INFO] Final Memory: 45M/123M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile) on project hadoop-hdfs-raid: Compilation failure: Compilation failure:
[ERROR] /Users/schen/Work/hadoop-apache-commit/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:[251,26] cannot find symbol
[ERROR] symbol : constructor PacketHeader(int,long,long,boolean,int)
[ERROR] location: class org.apache.hadoop.hdfs.protocol.datatransfer.PacketHeader
[ERROR] /Users/schen/Work/hadoop-apache-commit/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java:[52,21] cannot find symbol
[ERROR] symbol : method getBlockLocations(java.lang.String,long,long,boolean,boolean)
[ERROR] location: class org.apache.hadoop.hdfs.server.namenode.FSNamesystem
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs-raid
{code}
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Scott Chen resolved MAPREDUCE-3868.
-----------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
I just committed this. Thanks, Weiyan.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated MAPREDUCE-3868:
------------------------------------------
Attachment: MAPREDUCE-3868v1.patch
MAPREDUCE-3868v1.sh
Ram,
Attached are script/patch v1 that mavenize RAIDs and integrate it with the Maven build. Still testcases are failing.
You could use them as bootstrap for your work.
Thanks.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Ramkumar Vadali
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396454#comment-13396454 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2388 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2388/])
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548)
Result = FAILURE
schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351548
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418732#comment-13418732 ]
Eli Collins commented on MAPREDUCE-3868:
----------------------------------------
I've reverted this. The HDFS build has been red (due to An Ant BuildException has occured in the hdfs raid project) since this was committed a month ago, the test still fails consistently (HDFS-3554) and the findbugs warnings have not been resolved (HDFS-3563). This patch needs more love before it's ready to go in.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398770#comment-13398770 ]
Jason Lowe commented on MAPREDUCE-3868:
---------------------------------------
I updated the patch in HDFS-3549 to fix the findbugs build failures, and apparently there are 31 new findbugs warnings being reported. Also TestRaidNode is consistently failing, were the raid unit tests passing before this was committed?
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399016#comment-13399016 ]
Scott Chen commented on MAPREDUCE-3868:
---------------------------------------
Yes, the tests passed before checked in. Maybe it is something non-deterministic.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weiyan Wang updated MAPREDUCE-3868:
-----------------------------------
Attachment: MAPREDUCE-3868.patch
Fix all the unit tests to make it work with yarn
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396700#comment-13396700 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1081 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1081/])
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548)
Result = FAILURE
schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351548
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418746#comment-13418746 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2504 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2504/])
Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363572
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296009#comment-13296009 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
Alejandro Abdelnur, sorry I don't get it, what history you want to keep? and how can I verify the history is not lost?
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13393520#comment-13393520 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
Move to svn, @Scott, please follow below steps to apply the patch:
1. run MAPREDUCE-3868v1.sh svn (you may need to modify the script to use MKPARENT="--parents")
2. patch -p0 -i MAPREDUCE-3868-3.patch
3. svn add hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
4. svn add hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295964#comment-13295964 ]
Scott Chen commented on MAPREDUCE-3868:
---------------------------------------
+1 The patch looks good to me.
I will commit this later.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396434#comment-13396434 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2369 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2369/])
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548)
Result = SUCCESS
schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351548
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "dhruba borthakur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212047#comment-13212047 ]
dhruba borthakur commented on MAPREDUCE-3868:
---------------------------------------------
If we can make Raid run wel with MR2, that should be good.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Ramkumar Vadali
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397974#comment-13397974 ]
Jason Lowe commented on MAPREDUCE-3868:
---------------------------------------
This also broke the dist tar build - see HDFS-3549.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396979#comment-13396979 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
@Eli, sorry I don't know this is needed. How could I test jenkins jobs manually when I test my fix?
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296097#comment-13296097 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
with GIT you just move things and GIT finds out that is a move, so nothing special there. The thing is, when committing this to Apache, it is an SVN repo, that is why the script (which locally I use it in 'fs' mode because I use GIT)
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weiyan Wang updated MAPREDUCE-3868:
-----------------------------------
Attachment: MAPREDUCE-3868-1.patch
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396785#comment-13396785 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1114 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1114/])
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548)
Result = FAILURE
schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351548
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13413067#comment-13413067 ]
Eli Collins commented on MAPREDUCE-3868:
----------------------------------------
TestRaidNode is still consistently failing, I filed HDFS-3648 for this.
Weiyan/Scott - can you guys address the findbugs and test failures soon?
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weiyan Wang updated MAPREDUCE-3868:
-----------------------------------
Attachment: MAPREDUCE-3868-3.patch
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated MAPREDUCE-3868:
-----------------------------------
Target Version/s: 3.0.0
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396462#comment-13396462 ]
Andrew Purtell commented on MAPREDUCE-3868:
-------------------------------------------
Can we get this on branch-2?
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295986#comment-13295986 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
@Weiyan, the latest patch size is 651K, it seems it is not using the script of the original patch to move things around (and keep history). Would you mind doing a script/patch update so we don't lose the history? thx
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418786#comment-13418786 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2525 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2525/])
Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363572
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13393407#comment-13393407 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
@Weiyan, if we would use GIT I would have said nothing, but Apache Hadoop uses SVN, GIT is just a mirror. thx
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397859#comment-13397859 ]
Thomas Graves commented on MAPREDUCE-3868:
------------------------------------------
this also introduced a bunch of javadoc warnings - see HDFS-3550
if you don't have findbugs to exclude remove that from the pom file. If you do put the file in svn. You can test by running test-patch manually.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278232#comment-13278232 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
Weiyang, FYI MAPREDUCE-4266 is going to clean up all ANT not used stuff. This means that you'll have to get the RAID code from SVN from the commit prior to MAPREDUCE-4266 when doing you integration.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13393358#comment-13393358 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
My new patch is MAPREDUCE-3868-2.patch, you could check the log using
git log --follow Filename
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418739#comment-13418739 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2569 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2569/])
Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363572
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3868) Reenable Raid
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang reassigned MAPREDUCE-3868:
----------------------------------------
Assignee: Weiyan Wang (was: Ramkumar Vadali)
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (MAPREDUCE-3868) Reenable Raid
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins reopened MAPREDUCE-3868:
------------------------------------
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237557#comment-13237557 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
Ram, Dhruba, any update on this? Thxs
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Ramkumar Vadali
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398178#comment-13398178 ]
Scott Chen commented on MAPREDUCE-3868:
---------------------------------------
Sorry for causing the trouble.
I should have run findbugs before checking this in.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396437#comment-13396437 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2439 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2439/])
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) (Revision 1351548)
Result = SUCCESS
schen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351548
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/conf
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRaidUtil.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/BlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/DistRaid.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/GaloisField.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/JobMonitor.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/RaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/java/org/apache/hadoop/raid/ReedSolomonCode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/main/sbin
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/hdfs/TestRaidDfs.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestBlockFixer.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestDirectoryTraversal.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestErasureCodes.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidFilter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidHar.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidPurge.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShell.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestRaidShellFsck.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonDecoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/src/test/java/org/apache/hadoop/raid/TestReedSolomonEncoder.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/bin
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/conf
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/java/org
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid/src/test/org
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396817#comment-13396817 ]
Eli Collins commented on MAPREDUCE-3868:
----------------------------------------
The hdfs trunk jenkins job is failing with the following now, looks like some dev-support files are missing.
{noformat}
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
...
[ERROR] Could not find resource '/home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk/trunk/hadoop-hdfs-project/hadoop-hdfs-raid/dev-support/findbugsExcludeFile.xml'. -> [Help 1]
{noformat}
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296093#comment-13296093 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
Thanks! I will use "git mv" to keep the history. It seems changes in the recent two weeks break some tests. I am going to fix them, sigh...
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278999#comment-13278999 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
Alejandro, I just pick up the task recently. And thanks for your instruction, I already fixed some bugs. But still working on the remaining ones.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419159#comment-13419159 ]
Hudson commented on MAPREDUCE-3868:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1142 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1142/])
Revert MAPREDUCE-3868. Reenable Raid. (Revision 1363572)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1363572
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-raid-dist.xml
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-raid
* /hadoop/common/trunk/hadoop-hdfs-project/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/raid
* /hadoop/common/trunk/hadoop-project/pom.xml
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Scott Chen updated MAPREDUCE-3868:
----------------------------------
Issue Type: Bug (was: New Feature)
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868-3.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295944#comment-13295944 ]
Weiyan Wang commented on MAPREDUCE-3868:
----------------------------------------
rebase, the patch is generated from git diff.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276381#comment-13276381 ]
Scott Chen commented on MAPREDUCE-3868:
---------------------------------------
Weiyang: Thanks for volunteering on this. Looking forward to your patch :)
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295940#comment-13295940 ]
Scott Chen commented on MAPREDUCE-3868:
---------------------------------------
Patch doesn't apply. Can you rebase?
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Ramkumar Vadali (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212044#comment-13212044 ]
Ramkumar Vadali commented on MAPREDUCE-3868:
--------------------------------------------
Thanks Alejandro! I have started with your patch, and am starting to look with TestRaidDfs, which does not need a MiniMRCluster.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Ramkumar Vadali
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209614#comment-13209614 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
Ram,
A few tips that may be useful when doing the integration:
* If using and IDE (I use Idea) you may have to change the scope of hadoop-minicluster to compile for the IDE to pick all necessary JARs (Idea seems to get confused otherwise). From the command line (Maven) things work fine with the (correct) test scope.
* You don't need to build the whole Hadoop project every time. Instead do the following:
** Run once, from root level 'mvn install -DskipTests'
** then CD to hadoop-hdfs-project/hadoop-hdsf-raid and work from there.
** You can do Maven command or point your IDE to the POM there.
** Make sure you are using -offline with Maven command and in your IDE (else you may pick up newer snapshot JARs/POMs from Apache that don't have the changes this patch added)
* The new YARN base MiniCluster still has some issues, on failures you have runaway processes (the shutdown logic is broken, a JIRA to fix that is in the works MAPREDUCE-3634)
** What i do is a 'ps -ef | grep java' and then kill the dangling processes
* Sometimes (at least in Mac OS) MiniDFS finds some local files and things it is locked and testcases fail because of that. If that is the case, delete those files.
* After doing a build javadocs stuff sometimes creates a dir api at src level, ignore that DIR (don't add it to your patch)
* the distribution layout follows the new layout, I've put the scripts in the right places, but I have not modified the scripts to look for things in the right places
* the full distribution must be done from root level, do 'mvn clean package -DskipTests -Pdist', the full distribution will be in hadoop-dist/target/....
* the testcases that start MR jobs (and maybe the main code) will have to setup the framework to YARN, you have to set in your job conf the following property: mapreduce.framework.name=yarn (the streaming porting did this HADOOP-7590)
* in the testcases, you may have to add your classes as attached JAR, use the JarFinder.getJar() class to get the RAID JAR (the streaming porting did this HADOOP-7590).
* Some MiniMRCluster methods related to MR1 throw UnsupportedOperationExceptions, you may have to find other ways of getting the right info. For example: MiniMRCluster.getJobTrackerPort() now throws UOE, you should use instead MiniMRCluster.createJobConf().get(JTConfig.JT_IPC_ADDRESS)
* I've modified the TestBlockFixer with the last 2 items and TestBlockFixerBlockFixDist.testBlockFixDist() test get to start and run for long before failing.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Ramkumar Vadali
> Attachments: MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3868) Reenable Raid
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296072#comment-13296072 ]
Alejandro Abdelnur commented on MAPREDUCE-3868:
-----------------------------------------------
most of the patch is just moving files around, doing that with 'patch' will delete/create those files and subversion will not know bind them. This means that all changes prior this this JIRA will be lost as all the moved files will be (from SVN perspective) new files. you won't be able to track previous changes directly. The original patch I've submitted as a script/combo patch, the script does 'svn mv' which tells SVN to bind the files in the new location with the old location thus allowing you to trace changes to the first commit of the files. the script works both in filesystem and SVN mode.
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3868) Reenable Raid
Posted by "Weiyan Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weiyan Wang updated MAPREDUCE-3868:
-----------------------------------
Attachment: MAPREDUCE-3868-2.patch
> Reenable Raid
> -------------
>
> Key: MAPREDUCE-3868
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3868
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/raid
> Reporter: Scott Chen
> Assignee: Weiyan Wang
> Attachments: MAPREDUCE-3868-1.patch, MAPREDUCE-3868-2.patch, MAPREDUCE-3868.patch, MAPREDUCE-3868v1.patch, MAPREDUCE-3868v1.sh
>
>
> Currently Raid is outdated and not compiled. Make it compile.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira