You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "John Sichi (JIRA)" <ji...@apache.org> on 2010/08/23 19:12:16 UTC
[jira] Resolved: (HIVE-1512) Need to get hive_hbase-handler to work
with hbase versions 0.20.4 0.20.5 and cloudera CDH3 version
[ https://issues.apache.org/jira/browse/HIVE-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi resolved HIVE-1512.
------------------------------
Hadoop Flags: [Reviewed]
Resolution: Fixed
Committed. Thanks Basab!
> Need to get hive_hbase-handler to work with hbase versions 0.20.4 0.20.5 and cloudera CDH3 version
> ---------------------------------------------------------------------------------------------------
>
> Key: HIVE-1512
> URL: https://issues.apache.org/jira/browse/HIVE-1512
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.7.0
> Reporter: Jimmy Hu
> Assignee: Basab Maulik
> Fix For: 0.7.0
>
> Attachments: HIVE-1512.2.patch, HIVE-1512.3.patch, HIVE-1512.patch
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> the current trunk hive_hbase-handler only works with hbase 0.20.3, we need to get it to work with hbase versions 0.20.4 0.20.5 and cloudera CDH3 version
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Resolved: (HIVE-1512) Need to get hive_hbase-handler to
work with hbase versions 0.20.4 0.20.5 and cloudera CDH3 version
Posted by Ted Yu <yu...@gmail.com>.
Right now I see when accessing https://issues.apache.org/jira/browse/HIVE-1512:
com.atlassian.jira.exception.DataAccessException:
org.ofbiz.core.entity.GenericDataSourceException: Unable to esablish a
connection with the database. (FATAL: database is not accepting
commands to avoid wraparound data loss in database "postgres")
Maybe Apache should switch to HBase as data source :-)
On Wed, Aug 25, 2010 at 12:10 PM, Basab Maulik <bk...@gmail.com> wrote:
> I have created HIVE 1597 to track this issue. The fix for HIVE-1512 does
> not
> resolve the issue below.
>
> Basab
>
> On Mon, Aug 23, 2010 at 3:09 PM, Rajappa Iyer <rs...@mayin.org> wrote:
>
> > Perhaps I am missing something, but I cannot get this to work:
> >
> > /Users/riyer/src/ext/hive-trunk/build/dist/bin/hive --auxpath
> >
> >
> /Users/riyer/src/ext/hive-trunk/build/hbase-handler/hive_hbase-handler.jar,/Users/riyer/.jars/hbase-0.89.20100621+17.jar,/Users/riyer/src/ext/hive-trunk/hbase-handler/lib/zookeeper-3.2.2.jar
> > -hiveconf hbase.zookeeper.quorum=10.2.128.92,10.2.130.82,10.2.131.57
> > Hive history
> file=/tmp/riyer/hive_job_log_riyer_201008231505_440471748.txt
> > hive> CREATE TABLE hbase_table_1(key int, value string)
> > > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> > > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
> > > TBLPROPERTIES ("hbase.table.name" = "xyz");
> > FAILED: Error in metadata:
> > MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
> > 10.2.128.92:60000
> > at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:376)
> > at
> > org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:72)
> > at
> >
> >
> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:62)
> > at
> >
> >
> org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:141)
> > at
> >
> >
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:285)
> > at
> > org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
> > at
> > org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:2173)
> > at
> org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:148)
> > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
> > at
> >
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:610)
> > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:479)
> > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:357)
> > at
> > org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:140)
> > at
> > org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:199)
> > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:351)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> > )
> > FAILED: Execution Error, return code 1 from
> > org.apache.hadoop.hive.ql.exec.DDLTask
> > hive>
> >
> > I get the same results with zookeeper-3.3.1+7.jar from CDH3
> >
> >
> > On Mon, Aug 23, 2010 at 10:12 AM, John Sichi (JIRA) <ji...@apache.org>
> > wrote:
> >
> > >
> > > [
> > >
> >
> https://issues.apache.org/jira/browse/HIVE-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
> > ]
> > >
> > > John Sichi resolved HIVE-1512.
> > > ------------------------------
> > >
> > > Hadoop Flags: [Reviewed]
> > > Resolution: Fixed
> > >
> > > Committed. Thanks Basab!
> > >
> > >
> > > > Need to get hive_hbase-handler to work with hbase versions 0.20.4
> > 0.20.5
> > > and cloudera CDH3 version
> > > >
> > >
> >
> ---------------------------------------------------------------------------------------------------
> > > >
> > > > Key: HIVE-1512
> > > > URL: https://issues.apache.org/jira/browse/HIVE-1512
> > > > Project: Hadoop Hive
> > > > Issue Type: Improvement
> > > > Components: HBase Handler
> > > > Affects Versions: 0.7.0
> > > > Reporter: Jimmy Hu
> > > > Assignee: Basab Maulik
> > > > Fix For: 0.7.0
> > > >
> > > > Attachments: HIVE-1512.2.patch, HIVE-1512.3.patch,
> > > HIVE-1512.patch
> > > >
> > > > Original Estimate: 48h
> > > > Remaining Estimate: 48h
> > > >
> > > > the current trunk hive_hbase-handler only works with hbase 0.20.3,
> we
> > > need to get it to work with hbase versions 0.20.4 0.20.5 and cloudera
> > CDH3
> > > version
> > >
> > > --
> > > This message is automatically generated by JIRA.
> > > -
> > > You can reply to this email to add a comment to the issue online.
> > >
> > >
> >
>
Re: [jira] Resolved: (HIVE-1512) Need to get hive_hbase-handler to
work with hbase versions 0.20.4 0.20.5 and cloudera CDH3 version
Posted by Basab Maulik <bk...@gmail.com>.
I have created HIVE 1597 to track this issue. The fix for HIVE-1512 does not
resolve the issue below.
Basab
On Mon, Aug 23, 2010 at 3:09 PM, Rajappa Iyer <rs...@mayin.org> wrote:
> Perhaps I am missing something, but I cannot get this to work:
>
> /Users/riyer/src/ext/hive-trunk/build/dist/bin/hive --auxpath
>
> /Users/riyer/src/ext/hive-trunk/build/hbase-handler/hive_hbase-handler.jar,/Users/riyer/.jars/hbase-0.89.20100621+17.jar,/Users/riyer/src/ext/hive-trunk/hbase-handler/lib/zookeeper-3.2.2.jar
> -hiveconf hbase.zookeeper.quorum=10.2.128.92,10.2.130.82,10.2.131.57
> Hive history file=/tmp/riyer/hive_job_log_riyer_201008231505_440471748.txt
> hive> CREATE TABLE hbase_table_1(key int, value string)
> > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
> > TBLPROPERTIES ("hbase.table.name" = "xyz");
> FAILED: Error in metadata:
> MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
> 10.2.128.92:60000
> at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:376)
> at
> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:72)
> at
>
> org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:62)
> at
>
> org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:141)
> at
>
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:285)
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
> at
> org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:2173)
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:148)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:610)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:479)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:357)
> at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:140)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:199)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:351)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> )
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask
> hive>
>
> I get the same results with zookeeper-3.3.1+7.jar from CDH3
>
>
> On Mon, Aug 23, 2010 at 10:12 AM, John Sichi (JIRA) <ji...@apache.org>
> wrote:
>
> >
> > [
> >
> https://issues.apache.org/jira/browse/HIVE-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
> ]
> >
> > John Sichi resolved HIVE-1512.
> > ------------------------------
> >
> > Hadoop Flags: [Reviewed]
> > Resolution: Fixed
> >
> > Committed. Thanks Basab!
> >
> >
> > > Need to get hive_hbase-handler to work with hbase versions 0.20.4
> 0.20.5
> > and cloudera CDH3 version
> > >
> >
> ---------------------------------------------------------------------------------------------------
> > >
> > > Key: HIVE-1512
> > > URL: https://issues.apache.org/jira/browse/HIVE-1512
> > > Project: Hadoop Hive
> > > Issue Type: Improvement
> > > Components: HBase Handler
> > > Affects Versions: 0.7.0
> > > Reporter: Jimmy Hu
> > > Assignee: Basab Maulik
> > > Fix For: 0.7.0
> > >
> > > Attachments: HIVE-1512.2.patch, HIVE-1512.3.patch,
> > HIVE-1512.patch
> > >
> > > Original Estimate: 48h
> > > Remaining Estimate: 48h
> > >
> > > the current trunk hive_hbase-handler only works with hbase 0.20.3, we
> > need to get it to work with hbase versions 0.20.4 0.20.5 and cloudera
> CDH3
> > version
> >
> > --
> > This message is automatically generated by JIRA.
> > -
> > You can reply to this email to add a comment to the issue online.
> >
> >
>
Re: [jira] Resolved: (HIVE-1512) Need to get hive_hbase-handler to
work with hbase versions 0.20.4 0.20.5 and cloudera CDH3 version
Posted by Rajappa Iyer <rs...@mayin.org>.
Perhaps I am missing something, but I cannot get this to work:
/Users/riyer/src/ext/hive-trunk/build/dist/bin/hive --auxpath
/Users/riyer/src/ext/hive-trunk/build/hbase-handler/hive_hbase-handler.jar,/Users/riyer/.jars/hbase-0.89.20100621+17.jar,/Users/riyer/src/ext/hive-trunk/hbase-handler/lib/zookeeper-3.2.2.jar
-hiveconf hbase.zookeeper.quorum=10.2.128.92,10.2.130.82,10.2.131.57
Hive history file=/tmp/riyer/hive_job_log_riyer_201008231505_440471748.txt
hive> CREATE TABLE hbase_table_1(key int, value string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
> TBLPROPERTIES ("hbase.table.name" = "xyz");
FAILED: Error in metadata:
MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException:
10.2.128.92:60000
at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:376)
at
org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:72)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.getHBaseAdmin(HBaseStorageHandler.java:62)
at
org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:141)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:285)
at
org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:326)
at
org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:2173)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:148)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:610)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:479)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:357)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:140)
at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:199)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:351)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
)
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask
hive>
I get the same results with zookeeper-3.3.1+7.jar from CDH3
On Mon, Aug 23, 2010 at 10:12 AM, John Sichi (JIRA) <ji...@apache.org> wrote:
>
> [
> https://issues.apache.org/jira/browse/HIVE-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> John Sichi resolved HIVE-1512.
> ------------------------------
>
> Hadoop Flags: [Reviewed]
> Resolution: Fixed
>
> Committed. Thanks Basab!
>
>
> > Need to get hive_hbase-handler to work with hbase versions 0.20.4 0.20.5
> and cloudera CDH3 version
> >
> ---------------------------------------------------------------------------------------------------
> >
> > Key: HIVE-1512
> > URL: https://issues.apache.org/jira/browse/HIVE-1512
> > Project: Hadoop Hive
> > Issue Type: Improvement
> > Components: HBase Handler
> > Affects Versions: 0.7.0
> > Reporter: Jimmy Hu
> > Assignee: Basab Maulik
> > Fix For: 0.7.0
> >
> > Attachments: HIVE-1512.2.patch, HIVE-1512.3.patch,
> HIVE-1512.patch
> >
> > Original Estimate: 48h
> > Remaining Estimate: 48h
> >
> > the current trunk hive_hbase-handler only works with hbase 0.20.3, we
> need to get it to work with hbase versions 0.20.4 0.20.5 and cloudera CDH3
> version
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>