You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Giridharan Kesavan (JIRA)" <ji...@apache.org> on 2010/11/09 06:47:23 UTC
[jira] Created: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
RaidBlockSender.java compilation fails
--------------------------------------
Key: MAPREDUCE-2179
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/raid
Affects Versions: 0.22.0
Reporter: Giridharan Kesavan
Priority: Blocker
https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
Mapreduce trunk compilation is broken with
compile:
[echo] contrib: raid
[javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
[javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
[javac] symbol : class BlockTransferThrottler
[javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
[javac] private BlockTransferThrottler throttler;
[javac] ^
[javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
[javac] symbol : class BlockTransferThrottler
[javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
[javac] BlockTransferThrottler throttler) throws IOException {
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12930001#action_12930001 ]
Scott Chen commented on MAPREDUCE-2179:
---------------------------------------
Nigel: Sorry. I missed your comments.
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929999#action_12929999 ]
Nigel Daley commented on MAPREDUCE-2179:
----------------------------------------
FWIW, I got OOM errors running the tests. Adding this fixed it:
{code}
===================================================================
--- src/contrib/raid/build.xml (revision 1032497)
+++ src/contrib/raid/build.xml (working copy)
@@ -35,7 +35,7 @@
<target name="test-junit" depends="compile,compile-test" if="test.available">
<junit showoutput="${test.output}" fork="yes" printsummary="yes" errorProperty="tests.failed"
- haltonfailure="no" failureProperty="tests.failed">
+ haltonfailure="no" failureProperty="tests.failed" maxmemory="1024m" >
<classpath refid="test.classpath"/>
<sysproperty key="test.build.data" value="${build.test}/data"/>
{code}
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Ramkumar Vadali (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ramkumar Vadali reassigned MAPREDUCE-2179:
------------------------------------------
Assignee: Ramkumar Vadali
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Ramkumar Vadali (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ramkumar Vadali updated MAPREDUCE-2179:
---------------------------------------
Attachment: MAPREDUCE-2179.patch
r1032836 (HDFS-1457) removed the class BlockTransferThrottler. The RAID code does not need that functionality, so this patch just removes the dependence on BlockTransferThrottler.
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12930019#action_12930019 ]
Hudson commented on MAPREDUCE-2179:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #533 (See [https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/533/])
MAPREDUCE-2179. Fix RaidBlockSender compilation failure. (Ramkumar Vadali via
schen)
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (MAPREDUCE-2179) RaidBlockSender.java
compilation fails
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120110#comment-13120110 ]
Hudson commented on MAPREDUCE-2179:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #29 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/29/])
MAPREDUCE-3137. Fix broken merge of MAPREDUCE-2179. Contributed by Hitesh Shah.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178524
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Scott Chen updated MAPREDUCE-2179:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.22.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks Ram.
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (MAPREDUCE-2179) RaidBlockSender.java
compilation fails
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016925#comment-13016925 ]
Hudson commented on MAPREDUCE-2179:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #643 (See [https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/643/])
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929980#action_12929980 ]
Nigel Daley commented on MAPREDUCE-2179:
----------------------------------------
Looks like HDFS-1457 removed BlockTransferThrottler.java: http://svn.apache.org/viewvc?view=revision&revision=1032836
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Priority: Blocker
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12930003#action_12930003 ]
Scott Chen commented on MAPREDUCE-2179:
---------------------------------------
Nigel: Should we fix the OOM issue in another patch?
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Ramkumar Vadali (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ramkumar Vadali updated MAPREDUCE-2179:
---------------------------------------
Status: Patch Available (was: Open)
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Ramkumar Vadali (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929995#action_12929995 ]
Ramkumar Vadali commented on MAPREDUCE-2179:
--------------------------------------------
ant test-patch will not run since trunk compilation is broken.
I have run raid unit-tests:
{code}
test-junit:
[junit] WARNING: multiple versions of ant detected in path for junit
[junit] jar:file:/home/rvadali/local/external/ant/lib/ant.jar!/org/apache/tools/ant/Project.class
[junit] and jar:file:/home/rvadali/.ivy2/cache/ant/ant/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
[junit] Running org.apache.hadoop.hdfs.TestRaidDfs
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 41.64 sec
[junit] Running org.apache.hadoop.raid.TestBlockFixer
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 139.487 sec
[junit] Running org.apache.hadoop.raid.TestDirectoryTraversal
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 9.169 sec
[junit] Running org.apache.hadoop.raid.TestErasureCodes
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 26.334 sec
[junit] Running org.apache.hadoop.raid.TestGaloisField
[junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.399 sec
[junit] Running org.apache.hadoop.raid.TestHarIndexParser
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.051 sec
[junit] Running org.apache.hadoop.raid.TestRaidFilter
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.473 sec
[junit] Running org.apache.hadoop.raid.TestRaidHar
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 70.16 sec
[junit] Running org.apache.hadoop.raid.TestRaidNode
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 406.19 sec
[junit] Running org.apache.hadoop.raid.TestRaidPurge
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 107.977 sec
[junit] Running org.apache.hadoop.raid.TestRaidShell
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 26.168 sec
test:
BUILD SUCCESSFUL
Total time: 14 minutes 12 seconds
{code}
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929990#action_12929990 ]
Scott Chen commented on MAPREDUCE-2179:
---------------------------------------
Right now raid can be broken by HDFS because it is not using the public API of HDFS.
We need to have HDFS-1461 and refactor RaidBlockSender to get rid of this dependency.
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (MAPREDUCE-2179) RaidBlockSender.java
compilation fails
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120067#comment-13120067 ]
Hudson commented on MAPREDUCE-2179:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #36 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/36/])
MAPREDUCE-3137. Fix broken merge of MAPREDUCE-2179. Contributed by Hitesh Shah.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178524
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2179) RaidBlockSender.java compilation
fails
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12929992#action_12929992 ]
Scott Chen commented on MAPREDUCE-2179:
---------------------------------------
+1
The patch looks good to me.
Ram: Can you post the test results here?
> RaidBlockSender.java compilation fails
> --------------------------------------
>
> Key: MAPREDUCE-2179
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2179
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Affects Versions: 0.22.0
> Reporter: Giridharan Kesavan
> Assignee: Ramkumar Vadali
> Priority: Blocker
> Attachments: MAPREDUCE-2179.patch
>
>
> https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk/490/consoleFull
> Mapreduce trunk compilation is broken with
> compile:
> [echo] contrib: raid
> [javac] Compiling 27 source files to /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/raid/classes
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:71: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] private BlockTransferThrottler throttler;
> [javac] ^
> [javac] /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/raid/src/java/org/apache/hadoop/hdfs/server/datanode/RaidBlockSender.java:377: cannot find symbol
> [javac] symbol : class BlockTransferThrottler
> [javac] location: class org.apache.hadoop.hdfs.server.datanode.RaidBlockSender
> [javac] BlockTransferThrottler throttler) throws IOException {
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 2 errors
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.