You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Zhihong Yu (Created) (JIRA)" <ji...@apache.org> on 2012/01/13 05:09:50 UTC
[jira] [Created] (HBASE-5191) Fix compilation error against hadoop
0.23.1
Fix compilation error against hadoop 0.23.1
-------------------------------------------
Key: HBASE-5191
URL: https://issues.apache.org/jira/browse/HBASE-5191
Project: HBase
Issue Type: Bug
Reporter: Zhihong Yu
>From Mahadev:
I just checked out 0.92 branch and tried running:
mvn -Dhadoop.profile=23 clean test
-Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
Looks like a compilation issue:
------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
(default-testCompile) on project hbase: Compilation failure
[ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
cannot find symbol
[ERROR] symbol : variable dnRegistration
[ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
[ERROR] -> [Help 1]
[ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5191) Fix compilation error against
hadoop 0.23.1
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185430#comment-13185430 ]
Zhihong Yu commented on HBASE-5191:
-----------------------------------
After getting over NoSuchMethodException, the test failed with:
{code}
testLogRollOnPipelineRestart(org.apache.hadoop.hbase.regionserver.wal.TestLogRolling) Time elapsed: 48.086 sec <<< ERROR!
java.io.IOException: Cannot obtain block length for LocatedBlock{BP-842011159-192.168.0.11-1326429822518:blk_6287795838555417459_1014; getBlockSize()=1828; corrupt=false; offset=0; locs=[127.0.0.1:59451, 127.0.0.1:59455]}
at org.apache.hadoop.hdfs.DFSInputStream.readBlockLength(DFSInputStream.java:197)
at org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:141)
at org.apache.hadoop.hdfs.DFSInputStream.<init>(DFSInputStream.java:112)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:737)
at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:235)
at org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1768)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.openFile(SequenceFileLogReader.java:66)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1688)
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1709)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:58)
at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(SequenceFileLogReader.java:166)
at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:692)
at org.apache.hadoop.hbase.regionserver.wal.TestLogRolling.testLogRollOnPipelineRestart(TestLogRolling.java:497)
{code}
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5191) Fix compilation error against hadoop
0.23.1
Posted by "Zhihong Yu (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Yu updated HBASE-5191:
------------------------------
Affects Version/s: 0.92.0
Fix Version/s: 0.94.0
0.92.0
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-5191) Fix compilation error against hadoop
0.23.1
Posted by "Zhihong Yu (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Yu resolved HBASE-5191.
-------------------------------
Resolution: Fixed
Fixed as part of HBASE-5212
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.1
>
> Attachments: 5191.txt
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5191) Fix compilation error against
hadoop 0.23.1
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13187298#comment-13187298 ]
Mahadev konar commented on HBASE-5191:
--------------------------------------
@Ted,
Thanks for running through this. Any further update? Can I help in any way?
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
> Attachments: 5191.txt
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5191) Fix compilation error against hadoop
0.23.1
Posted by "Zhihong Yu (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Yu updated HBASE-5191:
------------------------------
Attachment: 5191.txt
This patch allows me to make some progress.
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
> Attachments: 5191.txt
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5191) Fix compilation error against
hadoop 0.23.1
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13187300#comment-13187300 ]
Zhihong Yu commented on HBASE-5191:
-----------------------------------
I haven't found out why the assertion doesn't fail in HBase trunk - I basically used an equivalent dfsCluster.stopDataNode() call.
Since any patch has to make TestLogRolling pass for hadoop 1.0, I am still searching for the transformation.
This effort was partially sidetracked by work on 0.92
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
> Attachments: 5191.txt
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5191) Fix compilation error against
hadoop 0.23.1
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185974#comment-13185974 ]
Zhihong Yu commented on HBASE-5191:
-----------------------------------
After the dfsCluster.stopDataNode( i ) call, the following assertion fails (with hadoop 1.0)
{code}
assertTrue("DataNodes " + dfsCluster.getDataNodes().size() +
" default replication " + fs.getDefaultReplication(),
dfsCluster.getDataNodes().size() >= fs.getDefaultReplication() + 1);
{code}
{code}
Failed tests: testLogRollOnDatanodeDeath(org.apache.hadoop.hbase.regionserver.wal.TestLogRolling): DataNodes 2 default replication 2
{code}
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
> Attachments: 5191.txt
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5191) Fix compilation error against
hadoop 0.23.1
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185428#comment-13185428 ]
Zhihong Yu commented on HBASE-5191:
-----------------------------------
After fixing the compilation error, the test failed with:
{code}
testLogRollOnDatanodeDeath(org.apache.hadoop.hbase.regionserver.wal.TestLogRolling) Time elapsed: 20.471 sec <<< FAILURE!
java.lang.AssertionError: Need HDFS-826 for this test
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.hadoop.hbase.regionserver.wal.TestLogRolling.testLogRollOnDatanodeDeath(TestLogRolling.java:318)
{code}
This is the related line:
{code}
assertTrue("Need HDFS-826 for this test", log.canGetCurReplicas());
{code}
This is how we retrieve getNumCurrentReplicas method in HLog:
{code}
private Method getGetNumCurrentReplicas(final FSDataOutputStream os) {
Method m = null;
Exception exception = null;
if (os != null) {
try {
m = os.getWrappedStream().getClass().
getMethod("getNumCurrentReplicas", new Class<?> []{});
m.setAccessible(true);
{code}
Here is the exception:
{code}
java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSOutputStream.getNumCurrentReplicas()
at java.lang.Class.getMethod(Class.java:1605)
at org.apache.hadoop.hbase.regionserver.wal.HLog.getGetNumCurrentReplicas(HLog.java:458)
at org.apache.hadoop.hbase.regionserver.wal.HLog.<init>(HLog.java:441)
{code}
> Fix compilation error against hadoop 0.23.1
> -------------------------------------------
>
> Key: HBASE-5191
> URL: https://issues.apache.org/jira/browse/HBASE-5191
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.0
> Reporter: Zhihong Yu
> Fix For: 0.92.0, 0.94.0
>
>
> From Mahadev:
> I just checked out 0.92 branch and tried running:
> mvn -Dhadoop.profile=23 clean test
> -Dtest=org.apache.hadoop.hbase.mapreduce.TestTableMapReduce
> Looks like a compilation issue:
> ------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.0.2:testCompile
> (default-testCompile) on project hbase: Compilation failure
> [ERROR] /Users/mahadev/workspace/hbase-workspace/hbase-git/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java:[341,33]
> cannot find symbol
> [ERROR] symbol : variable dnRegistration
> [ERROR] location: class org.apache.hadoop.hdfs.server.datanode.DataNode
> [ERROR] -> [Help 1]
> [ERROR]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira