You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by sagar nikam <sa...@gmail.com> on 2013/01/09 02:24:45 UTC

FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: in HBase+Hive intergration

Respected Sir,

Componet used:-
-Ubuntu 12.04, hive(0.9.0), hbase(0.94.3), hadoop(0.20.2)-single-node,
zookeeper-3.4.3, guava-11.0.2, hive-hbase-handler-0.9.0

tutorials:-https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration

steps
1) start hadoop,
2) start hbase-master
3) start hiveserver
4) start hive shell using --auxpath parameters as in tutorial
 (all works without errors -   when I jps,-->
JobTracker,HMaster,DataNode,NameNode,SecondaryNameNode,TaskTracker,Jps)

    hbase(main):001:0> status
    1 servers, 0 dead, 2.0000 average load


On hive shell I create can create table as

    CREATE TABLE IF NOT EXISTS familia (id_familia INT,fk_veiculo
INT,fk_cliente INT,nome STRING) ROW FORMAT delimited fields terminated by
',' STORED AS TEXTFILE;
    load data local inpath
'/home/trendwise/hive_data/tables_csv/familia.csv' overwrite into table
familia;

but when I do below query,nothing shown,just cursor blinking.I waited for
long time,then error shown

    CREATE TABLE hbase_familia_1 (key int, id_familia int, fk_veiculo
INT,fk_cliente INT,nome STRING)
    STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
    WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key, cf1:id_familia,
cf2:fk_veiculo,cf3:fk_cliente, cf4:nome")
    TBLPROPERTIES ("hbase.table.name" = "hbase_familia");

I did `list` on hbase shell,which didn't show any table what I tried ?

Error:-

    FAILED: Error in metadata:
MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
Retried 10 times
at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:73)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:147)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:398)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:538)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3305)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:242)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1326)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1118)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:258)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:689)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:557)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
    ) FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask

hbase-site.xml

    <property>
     <name>hbase.rootdir</name>
     <value>hdfs://localhost:54310/hbase</value>
    </property>
    <property>
     <name>dfs.replication</name>
     <value>1</value>
    </property>
    <property>
     <name>hbase.zookeeper.property.dataDir</name>
     <value>/home/trendwise/hadoop/hbase-0.94.3/hbase_dataDir</value>
    </property>
    <property>
     <name>hbase.zookeeper.property.clientPort</name>
     <value>2222</value>
     <description>Property from ZooKeeper's config zoo.cfg.
     </description>
    </property>
    <property>
     <name>hbase.zookeeper.quorum</name>
     <value>localhost</value>
     <description></description>
    </property>
    <property>
     <name>hbase.cluster.distributed</name>
     <value>true</value>
     <description></description>
    </property>


core-site.xml (Hadoop)

<configuration>
<property>
  <name>hadoop.tmp.dir</name>
  <value>/home/trendwise/hadoop/hadoop-0.20.2/hadoop_temp/</value>
  <description>A base for other temporary directories.</description>
</property>

<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:54310</value>
  <description>The name of the default file system.  A URI whose
  scheme and authority determine the FileSystem implementation.  The
  uri's scheme determines the config property (fs.SCHEME.impl) naming
  the FileSystem implementation class.  The uri's authority is used to
  determine the host, port, etc. for a filesystem.</description>
</property>

<property>
  <name>fs.inmemory.size.mb </name>
  <value>200 </value>
 </property>
<property>
  <name>io.sort.factor</name>
  <value>100 </value>
 </property>
<property>
  <name>io.sort.mb</name>
  <value>200 </value>
 </property>
<property>
  <name>io.file.buffer.size</name>
  <value>131072 </value>
 </property>

hive-site.xml (attached)

Re: FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: in HBase+Hive intergration

Posted by Ted Reynolds <te...@hortonworks.com>.
Hi Sagar,

If you do a jps after the error shows, do you still see HMaster in the
list?  It is possible that the Master came up for a bit and then died.

Ted.



On Tue, Jan 8, 2013 at 5:24 PM, sagar nikam <sa...@gmail.com> wrote:

> MasterNotRunningException