You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by hzwangxx <wh...@163.com> on 2013/12/16 08:58:43 UTC

HBase upgrade error

Hi，
    I want to upgrade hbase from 0.94 to 0.96. According to http://hbase.apache.org/book/upgrade0.96.html. I shutdown 0.94 cluster, use bin/hbase upgrade -check, I encountered a problem as follows:

13/12/16 15:43:08 INFO util.HFileV1Detector: Target dir is: hdfs://node01:9000/hbase
13/12/16 15:43:08 ERROR util.HFileV1Detector: java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
13/12/16 15:43:08 WARN migration.UpgradeTo96: There are some HFileV1, or corrupt files (files with incorrect major version).

and use bin/hbase upgrade -execute can list the trackers:
13/12/16 15:45:56 INFO zookeeper.ClientCnxn: EventThread shut down
13/12/16 15:45:56 INFO zookeeper.ZooKeeper: Session: 0x142f975e49e0003 closed
13/12/16 15:45:56 INFO migration.UpgradeTo96: Starting Namespace upgrade
13/12/16 15:45:57 WARN conf.Configuration: fs.default.name is deprecated. Instead, use fs.defaultFS
Exception in thread "main" java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
        at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto.getSerializedSize(ClientNamenodeProtocolProtos.java:18005)
        at com.google.protobuf.AbstractMessageLite.toByteString(AbstractMessageLite.java:49)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.constructRpcRequest(ProtobufRpcEngine.java:149)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:193)
        at sun.proxy.$Proxy10.getListing(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
        at sun.proxy.$Proxy10.getListing(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:440)
        at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1526)
        at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1509)
        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:407)
        at org.apache.hadoop.hbase.util.FSUtils.getVersion(FSUtils.java:473)
        at org.apache.hadoop.hbase.migration.NamespaceUpgrade.verifyNSUpgrade(NamespaceUpgrade.java:488)
        at org.apache.hadoop.hbase.migration.NamespaceUpgrade.upgradeTableDirs(NamespaceUpgrade.java:127)
        at org.apache.hadoop.hbase.migration.NamespaceUpgrade.run(NamespaceUpgrade.java:502)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.hbase.migration.UpgradeTo96.executeTool(UpgradeTo96.java:222)
        at org.apache.hadoop.hbase.migration.UpgradeTo96.executeUpgrade(UpgradeTo96.java:212)
        at org.apache.hadoop.hbase.migration.UpgradeTo96.run(UpgradeTo96.java:134)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.hbase.migration.UpgradeTo96.main(UpgradeTo96.java:258)

my hadoop version is: hadoop-2.0.0-cdh4.2.1 and hbase version is 0.94.0-cdh4.2.1.

Waiting for your help. Thanks~
Best Wishes!
hzwangxx

Re: HBase upgrade error

Posted by Ted Yu <yu...@gmail.com>.
The exception happened in protobuf

Can you upgrade hadoop to release 2.2 ?

Cheers

On Dec 15, 2013, at 11:58 PM, hzwangxx <wh...@163.com> wrote:

> Hi，
>    I want to upgrade hbase from 0.94 to 0.96. According to http://hbase.apache.org/book/upgrade0.96.html. I shutdown 0.94 cluster, use bin/hbase upgrade -check, I encountered a problem as follows:
> 
> 13/12/16 15:43:08 INFO util.HFileV1Detector: Target dir is: hdfs://node01:9000/hbase
> 13/12/16 15:43:08 ERROR util.HFileV1Detector: java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
> 13/12/16 15:43:08 WARN migration.UpgradeTo96: There are some HFileV1, or corrupt files (files with incorrect major version).
> 
> and use bin/hbase upgrade -execute can list the trackers:
> 13/12/16 15:45:56 INFO zookeeper.ClientCnxn: EventThread shut down
> 13/12/16 15:45:56 INFO zookeeper.ZooKeeper: Session: 0x142f975e49e0003 closed
> 13/12/16 15:45:56 INFO migration.UpgradeTo96: Starting Namespace upgrade
> 13/12/16 15:45:57 WARN conf.Configuration: fs.default.name is deprecated. Instead, use fs.defaultFS
> Exception in thread "main" java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
>        at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
>        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto.getSerializedSize(ClientNamenodeProtocolProtos.java:18005)
>        at com.google.protobuf.AbstractMessageLite.toByteString(AbstractMessageLite.java:49)
>        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.constructRpcRequest(ProtobufRpcEngine.java:149)
>        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:193)
>        at sun.proxy.$Proxy10.getListing(Unknown Source)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:616)
>        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
>        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>        at sun.proxy.$Proxy10.getListing(Unknown Source)
>        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:440)
>        at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1526)
>        at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1509)
>        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:407)
>        at org.apache.hadoop.hbase.util.FSUtils.getVersion(FSUtils.java:473)
>        at org.apache.hadoop.hbase.migration.NamespaceUpgrade.verifyNSUpgrade(NamespaceUpgrade.java:488)
>        at org.apache.hadoop.hbase.migration.NamespaceUpgrade.upgradeTableDirs(NamespaceUpgrade.java:127)
>        at org.apache.hadoop.hbase.migration.NamespaceUpgrade.run(NamespaceUpgrade.java:502)
>        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>        at org.apache.hadoop.hbase.migration.UpgradeTo96.executeTool(UpgradeTo96.java:222)
>        at org.apache.hadoop.hbase.migration.UpgradeTo96.executeUpgrade(UpgradeTo96.java:212)
>        at org.apache.hadoop.hbase.migration.UpgradeTo96.run(UpgradeTo96.java:134)
>        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>        at org.apache.hadoop.hbase.migration.UpgradeTo96.main(UpgradeTo96.java:258)
> 
> my hadoop version is: hadoop-2.0.0-cdh4.2.1 and hbase version is 0.94.0-cdh4.2.1.
> 
> Waiting for your help. Thanks~
> Best Wishes!
> hzwangxx