[jira] [Commented] (TRAFODION-9) Non-blocking hbase operation to smoothen the data flow in trafodion engine

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TRAFODION-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14599759#comment-14599759 ] 

ASF GitHub Bot commented on TRAFODION-9:
----------------------------------------

Github user selvaganesang commented on a diff in the pull request:

    https://github.com/apache/incubator-trafodion/pull/6#discussion_r33171328
  
    --- Diff: core/sqf/src/tm/tmlib.cpp ---
    @@ -647,6 +647,21 @@ short REGISTERREGION(long transid, long startid, int pv_port, char *pa_hostname,
        }
     
        TM_Transaction *lp_currTrans = gp_trans_thr->get_current();
    +   // Check if the passed-in transid is known to the thread
    +   // if so, make that Transid current
    +   if (lp_currTrans == NULL) {
    +      lp_currTrans = gp_trans_thr->get_trans (lv_transid.get_native_type());
    +      if (lp_currTrans != NULL) 
    +         gp_trans_thr->set_current(lp_currTrans);
    +   } 
    +   // Check if the thread's current transid matches the passed-in transid
    +   // If not, check if the passed-in transid is known to the thread
    +   // if so, make that Transid current
    +   else if (! lp_currTrans->equal(lv_transid)) {
    +      lp_currTrans = gp_trans_thr->get_trans (lv_transid.get_native_type());
    +      if (lp_currTrans != NULL) 
    +         gp_trans_thr->set_current(lp_currTrans);
    +   }
        TM_Transseq_Type lv_savedStartId = gp_trans_thr->get_startid();
    --- End diff --
    
    Similar code exists few lines above and lv_savedStartId and lv_startId are one and the same at line 677. Also, can we take care of this if there are any issue in the next check-in


> Non-blocking hbase operation to smoothen the data flow in trafodion engine
> --------------------------------------------------------------------------
>
>                 Key: TRAFODION-9
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-9
>             Project: Apache Trafodion
>          Issue Type: Improvement
>            Reporter: Selvaganesan
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> Currently, when a table has indexes, the row is first inserted into base table and then the corresponding rows are added into the indexes sequentially. Hbase operations are blocking. Hbase operations are done in a different thread making it non-blocking. This allowed the Trafodion engine to flow the tuples through other operators enabling other operators to be scheduled and the tuples processed by them. This allowed the Trafodion engine to initiate insert into base table and indexes in parallel.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)