You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jonathan Hsieh (JIRA)" <ji...@apache.org> on 2013/05/01 03:43:13 UTC

[jira] [Commented] (HBASE-8469) [hadoop2] Several tests break because of HDFS-4305

    [ https://issues.apache.org/jira/browse/HBASE-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13646284#comment-13646284 ] 

Jonathan Hsieh commented on HBASE-8469:
---------------------------------------

After HBASE-8472 is applied so that we can properly run tests against hadoop 2.0.5-SNAPSHOT, we get this before the patch applied:

{code}
~/proj/hbase$ mvn clean test   -Dhadoop.profile=2.0  -Dhadoop-two.version=2.0.5-SNAPSHOT  -Dtest=TestHRegion*,Test*Replication,TestFSUtils

-------------------------------------------------------
Running org.apache.hadoop.hbase.regionserver.TestHRegion
Tests run: 62, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 20.811 sec <<< FAILURE!
Running org.apache.hadoop.hbase.replication.TestMasterReplication
... (takes a very long time, canceled) ...
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.TestHRegionLocation
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.435 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegion
Tests run: 62, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 19.571 sec <<< FAILURE!
Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.669 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.514 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.629 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionBusyWait
Tests run: 63, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 20.729 sec <<< FAILURE!
Running org.apache.hadoop.hbase.regionserver.TestHRegionFileSystem
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.29 sec
Running org.apache.hadoop.hbase.replication.TestMasterReplication
... (hanging or taking way too long).
{code}

and this after
{code}
~/proj/hbase$ mvn clean test   -Dhadoop.profile=2.0  -Dhadoop-two.version=2.0.5-SNAPSHOT  -Dtest=TestHRegion*,Test*Replication,TestFSUtils
....
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.TestHRegionLocation
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.476 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegion
Tests run: 62, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.415 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.749 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.33 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.515 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionBusyWait
Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.96 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionFileSystem
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.215 sec
Running org.apache.hadoop.hbase.replication.TestMasterReplication
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.998 sec
Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.739 sec
Running org.apache.hadoop.hbase.util.TestFSUtils
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.387 sec
{code}
                
> [hadoop2] Several tests break because of HDFS-4305
> --------------------------------------------------
>
>                 Key: HBASE-8469
>                 URL: https://issues.apache.org/jira/browse/HBASE-8469
>             Project: HBase
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.98.0, 0.94.6.1, 0.95.0
>            Reporter: Jonathan Hsieh
>            Assignee: Jonathan Hsieh
>             Fix For: 0.98.0, 0.94.8, 0.95.1
>
>         Attachments: hbase-8469.patch
>
>
> Several unit tests will break due to HDFS-4305 (which enforces a min block size) because apprently, we set our block size smaller in these tests. 
> {code}
> Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 1024 < 1048576
>   at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:1816)
>   at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:1795)
>   at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:418)
>   at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:205)
>   at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44134)
>   at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
>   at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
>   at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1696)
>   at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1692)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:396)
>   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>   at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1690)
> {code}
> org.apache.hadoop.hbase.regionserver.TestHRegion.testgetHDFSBlocksDistribution
> org.apache.hadoop.hbase.regionserver.TestHRegionBusyWait.testgetHDFSBlocksDistribution
> org.apache.hadoop.hbase.replication.TestMasterReplication.testCyclicReplication
> org.apache.hadoop.hbase.replication.TestMasterReplication.testSimplePutDelete
> org.apache.hadoop.hbase.replication.TestMultiSlaveReplication.testMultiSlaveReplication
> org.apache.hadoop.hbase.util.TestFSUtils.testcomputeHDFSBlocksDistribution

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira