[jira] [Closed] (TRAFODION-238) LP Bug: 1311890 - Drop sb_histogram returns TMF 97 and causes mismatch between _MD_ and hbase

["Atanu Mishra (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TRAFODION-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Atanu Mishra closed TRAFODION-238.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 1.0 (pre-incubation)

> LP Bug: 1311890 - Drop sb_histogram returns TMF 97 and causes mismatch between _MD_ and hbase
> ---------------------------------------------------------------------------------------------
>
>                 Key: TRAFODION-238
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-238
>             Project: Apache Trafodion
>          Issue Type: Bug
>          Components: sql-cmp
>            Reporter: Weishiun Tsai
>            Assignee: Pavani Puppala
>            Priority: Blocker
>             Fix For: 1.0 (pre-incubation)
>
>
> When dropping a sb_histogram table in a schema, it returns TMF error 97.  Once this happens, the table gets into an inconsistent state between Trafodion metadata _MD_ and hbase.  As shown below in the output, ‘get tables’ from sqlci shows that sb_hisogram is there, but hbase shell shows that the table no longer exists.  At that point, any attempt to access sb_histogram will return errors 8609 and 8811.  The schema is not usable anymore for any tables that require statistics.  This problem is not only for dropping the table.  The table sb_histogram often gets into this inconsistent state whenever update statistics runs into errors.
> There may be 3 potential problems that need to be addressed here:
> (1) Why TMF error 97 is returned in the first place.
> (2) sb_histograms should not get into this inconsistent state between Trafodion metadata and hbase.
> (3) Once it gets into this inconsistent state, the 8609 and 8811 errors returned is very confusing.
> For now, the 3 problems are lumped together in this case.  Once more analysis is done, separate cases can be filed if needed.   
> This is seen on the datalake v39633 build installed on a workstation.  It’s fairly reproducible right now on this build.
> Here is the output from sqlci and hbase showing the problems and the inconsistency.
> XXXXXXXXXX SQLCI XXXXXXXXXXX
> -bash-4.1$ sqlci
> Trafodion Conversational Interface 0.7.0
> (c) Copyright 2014 Hewlett-Packard Development Company, LP.
> >>set schema mytest1;
> --- SQL operation complete.
> >>create table t (a int);
> --- SQL operation complete.
> >>update statistics for table t on every column;
> --- SQL operation complete.
> >>get tables;
> Tables in Schema TRAFODION.MYTEST1
> ==================================
> SB_HISTOGRAMS
> SB_HISTOGRAM_INTERVALS
> T
> --- SQL operation complete.
> XXXXXXXXXX HBASE XXXXXXXXXXX
> hbase(main):004:0> list 'MYTEST1.*'
> TABLE
> TRAFODION.MYTEST1.SB_HISTOGRAMS
> TRAFODION.MYTEST1.SB_HISTOGRAM_INTERVALS
> TRAFODION.MYTEST1.T
> 3 row(s) in 0.0190 seconds
> XXXXXXXXXX SQLCI XXXXXXXXXXX
> >>drop table t;
> --- SQL operation complete.
> >>get tables;
> Tables in Schema TRAFODION.MYTEST1
> ==================================
> SB_HISTOGRAMS
> SB_HISTOGRAM_INTERVALS
> --- SQL operation complete.
> XXXXXXXXXX HBASE XXXXXXXXXXX
> hbase(main):005:0> list 'MYTEST1.*'
> TABLE
> TRAFODION.MYTEST1.SB_HISTOGRAMS
> TRAFODION.MYTEST1.SB_HISTOGRAM_INTERVALS
> 2 row(s) in 0.0170 seconds
> XXXXXXXXXX SQLCI XXXXXXXXXXX
> >>drop table SB_HISTOGRAMS;
> *** ERROR[8606] Transaction subsystem TMF returned error 97 on a commit transaction.
> *** ERROR[8811] Trying to close a statement that is either not in the open state or has not reached EOF.
> --- SQL operation failed with errors.
> >>get tables;
> Tables in Schema TRAFODION.MYTEST1
> ==================================
> SB_HISTOGRAMS
> SB_HISTOGRAM_INTERVALS
> --- SQL operation complete.
> XXXXXXXXXX HBASE XXXXXXXXXXX
> hbase(main):006:0> list 'MYTEST1.*'
> TABLE
> TRAFODION.MYTEST1.SB_HISTOGRAM_INTERVALS
> 1 row(s) in 0.0110 seconds
> >>>>>>>>>>> NOTICE that SB_HISTOGRAMS is gone in hbase, but still exist in our _MD_ tables!
> XXXXXXXXXX SQLCI XXXXXXXXXXX
> >>drop table SB_HISTOGRAMS;
> *** ERROR[8609] Waited rollback performed without starting a transaction.
> *** ERROR[8811] Trying to close a statement that is either not in the open state or has not reached EOF.
> --- SQL operation failed with errors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)