You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "Atanu Mishra (JIRA)" <ji...@apache.org> on 2015/08/12 02:17:45 UTC
[jira] [Commented] (TRAFODION-214) LP Bug: 1302874 - Create index
on a table with 10K rows returns ERROR 8448
[ https://issues.apache.org/jira/browse/TRAFODION-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14692630#comment-14692630 ]
Atanu Mishra commented on TRAFODION-214:
----------------------------------------
Weishiun Tsai (wei-shiun-tsai) wrote on 2014-05-09: #3
Verified on the datalake v40158 build. This problem has been fixed:
>> create table t0 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
--- SQL operation complete.
>> create table t1 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
--- SQL operation complete.
>> create table t2 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
--- SQL operation complete.
>> create table t6 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
--- SQL operation complete.
>> create table t8 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
--- SQL operation complete.
>> create table t9 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
--- SQL operation complete.
>>
>>insert into t0 values (0,0,0),(1,1,1),(2,2,2),(3,3,3),(4,4,4),(5,5,5),(6,6,6),(7,7,7),(8,8,8),(9,9,9);
--- 10 row(s) inserted.
>> upsert using load into t1 select * from t0;
--- 10 row(s) inserted.
>> upsert using load into t2 select * from t0;
--- 10 row(s) inserted.
>> upsert using load into t6 select t1.a+10*t2.a,t1.a,t2.a from t1,t2;
--- 100 row(s) inserted.
>> upsert using load into t8 select t6.a+100*t1.a,t6.a,t1.a from t1,t6;
--- 1000 row(s) inserted.
>> upsert using load into t9 select t8.a+1000*t1.a,t8.a,t1.a from t1,t8;
--- 10000 row(s) inserted.
>>
>>select count(*) from t9;
(EXPR)
--------------------
10000
--- 1 row(s) selected.
>>
>>create index ix9b on t9(b);
--- SQL operation complete.
Changed in trafodion:
status: Fix Committed → Fix Released
> LP Bug: 1302874 - Create index on a table with 10K rows returns ERROR 8448
> --------------------------------------------------------------------------
>
> Key: TRAFODION-214
> URL: https://issues.apache.org/jira/browse/TRAFODION-214
> Project: Apache Trafodion
> Issue Type: Bug
> Components: dtm
> Reporter: Weishiun Tsai
> Assignee: Anoop Sharma
> Priority: Blocker
> Fix For: 0.9 (pre-incubation)
>
>
> Create index has trouble for a table around 10000 rows. The statement would run for a very long time (over an hour) and then eventually return various errors about hbase unable to find regions.
> Currently, this is fairly reproducible on centos-mapr1, a 6-node cluster that runs the datalake v38720 build. This may or may not be related to another case https://bugs.launchpad.net/trafodion/+bug/1297400 “create index hangs on a table with 10K rows”. Since the symptom is different and this one does clearly return an error message with diagnostic information. We are treating them as separate cases for now.
> Here is the entire script to reproduce this problem and the output of the script execution.
> [trafodion@centos-mapr1 scripts]$ cat mytest.sql
> log mytest.log clear;
> set schema mytest;
> create table t0 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> create table t1 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> create table t2 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> create table t6 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> create table t8 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> create table t9 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> insert into t0 values (0,0,0),(1,1,1),(2,2,2),(3,3,3),(4,4,4),(5,5,5),(6,6,6),(7,7,7),(8,8,8),(9,9,9);
> upsert using load into t1 select * from t0;
> upsert using load into t2 select * from t0;
> upsert using load into t6 select t1.a+10*t2.a,t1.a,t2.a from t1,t2;
> upsert using load into t8 select t6.a+100*t1.a,t6.a,t1.a from t1,t6;
> upsert using load into t9 select t8.a+1000*t1.a,t8.a,t1.a from t1,t8;
> select count(*) from t9;
> create index ix9b on t9(b);
> log off;
> -----------------------------------------------------------------------------------
> Trafodion Conversational Interface 0.7.0
> (c) Copyright 2014 Hewlett-Packard Development Company, LP.
> >>obey mytest.sql;
> >>log mytest.log clear;
> >>set schema mytest;
> --- SQL operation complete.
> >>create table t0 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> --- SQL operation complete.
> >>create table t1 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> --- SQL operation complete.
> >>create table t2 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> --- SQL operation complete.
> >>create table t6 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> --- SQL operation complete.
> >>create table t8 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> --- SQL operation complete.
> >>create table t9 (a int not null not droppable, b int, c int, primary key (a)) salt using 12 partitions;
> --- SQL operation complete.
> >>
> >>insert into t0 values (0,0,0),(1,1,1),(2,2,2),(3,3,3),(4,4,4),(5,5,5),(6,6,6),(7,7,7),(8,8,8),(9,9,9);
> --- 10 row(s) inserted.
> >>upsert using load into t1 select * from t0;
> --- 10 row(s) inserted.
> >>upsert using load into t2 select * from t0;
> --- 10 row(s) inserted.
> >>upsert using load into t6 select t1.a+10*t2.a,t1.a,t2.a from t1,t2;
> --- 100 row(s) inserted.
> >>upsert using load into t8 select t6.a+100*t1.a,t6.a,t1.a from t1,t6;
> --- 1000 row(s) inserted.
> >>upsert using load into t9 select t8.a+1000*t1.a,t8.a,t1.a from t1,t8;
> --- 10000 row(s) inserted.
> >>
> >>select count(*) from t9;
> (EXPR)
> --------------------
> 10000
> --- 1 row(s) selected.
> >>
> >>create index ix9b on t9(b);
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRows returned error HBASE_ACCESS_ERROR(-705). Cause:
> java.net.ConnectException: Connection refused
> sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:207)
> org.apache.hadoop.net.NetUtils.connect(NetUtils.java:528)
> org.apache.hadoop.net.NetUtils.connect(NetUtils.java:492)
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupConnection(HBaseClient.java:390)
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:436)
> org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1133)
> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:980)
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:86)
> com.sun.proxy.$Proxy9.getClosestRowBefore(Unknown Source)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1019)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:860)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1096)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:860)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:770)
> org.apache.hadoop.hbase.client.HTable.getRegionLocation(HTable.java:387)
> org.apache.hadoop.hbase.client.transactional.RMInterface.registerTransaction(RMInterface.java:79)
> org.apache.hadoop.hbase.client.transactional.RMInterface.put(RMInterface.java:152)
> org.trafodion.sql.HBaseAccess.HTableClient.insertRows(HTableClient.java:504)
> .
> *** ERROR[8811] Trying to close a statement that is either not in the open state or has not reached EOF.
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::getRowOpen returned error HBASE_OPEN_ERROR(-703). Cause:
> org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for TRAFODION._MD_.OBJECTS,TRAFODION MYTEST IX9B ,99999999999999 after 10 tries.
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:980)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:987)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:860)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:770)
> org.apache.hadoop.hbase.client.HTable.getRegionLocation(HTable.java:387)
> org.apache.hadoop.hbase.client.transactional.RMInterface.registerTransaction(RMInterface.java:79)
> org.apache.hadoop.hbase.client.transactional.RMInterface.get(RMInterface.java:121)
> org.trafodion.sql.HBaseAccess.HTableClient.startGet(HTableClient.java:214)
> .
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::getRowOpen returned error HBASE_OPEN_ERROR(-703). Cause:
> org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for TRAFODION._MD_.OBJECTS,TRAFODION MYTEST IX9B ,99999999999999 after 10 tries.
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:980)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:987)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:860)
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:770)
> org.apache.hadoop.hbase.client.HTable.getRegionLocation(HTable.java:387)
> org.apache.hadoop.hbase.client.transactional.RMInterface.registerTransaction(RMInterface.java:79)
> org.apache.hadoop.hbase.client.transactional.RMInterface.get(RMInterface.java:121)
> org.trafodion.sql.HBaseAccess.HTableClient.startGet(HTableClient.java:214)
> .
> *** ERROR[8811] Trying to close a statement that is either not in the open state or has not reached EOF.
> --- SQL operation failed with errors.
> >>log off;
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)