You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@trafodion.apache.org by se...@apache.org on 2016/05/16 04:23:52 UTC

[1/3] incubator-trafodion git commit: [TRAFODION-1971] Avoid redundant reinitialization during bulk load

Repository: incubator-trafodion
Updated Branches:
  refs/heads/master b3d353156 -> 0fed9585c


[TRAFODION-1971] Avoid redundant reinitialization during bulk load

After each flush during the preparation phase of bulk load, HFile
initialization was taking place redundantly. This imposed significant
overhead and slowed down loads.


Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/ad6f4cac
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/ad6f4cac
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/ad6f4cac

Branch: refs/heads/master
Commit: ad6f4cac31c58997db0a26cdefd614a5ee24ef54
Parents: ed93ea9
Author: Barry Fritchman <bl...@edev06.esgyn.local>
Authored: Fri May 13 04:15:52 2016 +0000
Committer: Barry Fritchman <bl...@edev06.esgyn.local>
Committed: Fri May 13 04:15:52 2016 +0000

----------------------------------------------------------------------
 core/sql/executor/ExHbaseIUD.cpp | 1 -
 1 file changed, 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/ad6f4cac/core/sql/executor/ExHbaseIUD.cpp
----------------------------------------------------------------------
diff --git a/core/sql/executor/ExHbaseIUD.cpp b/core/sql/executor/ExHbaseIUD.cpp
index bf3103a..44625dc 100644
--- a/core/sql/executor/ExHbaseIUD.cpp
+++ b/core/sql/executor/ExHbaseIUD.cpp
@@ -1285,7 +1285,6 @@ ExWorkProcRetcode ExHbaseAccessBulkLoadPrepSQTcb::work()
       matches_ = 0;
       currRowNum_ = 0;
       numRetries_ = 0;
-      hFileParamsInitialized_ = FALSE;
       prevTailIndex_ = 0;
       lastHandledStep_ = NOT_STARTED;
 


[3/3] incubator-trafodion git commit: Merge [TRAFODION-1971] PR 480 Avoid redundant reinitialization during bulk load

Posted by se...@apache.org.
Merge [TRAFODION-1971] PR 480 Avoid redundant reinitialization during bulk load


Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/0fed9585
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/0fed9585
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/0fed9585

Branch: refs/heads/master
Commit: 0fed9585c0d52ec42ebbe63650b273e13a489767
Parents: b3d3531 90ab020
Author: selvaganesang <se...@apache.org>
Authored: Mon May 16 04:21:20 2016 +0000
Committer: selvaganesang <se...@apache.org>
Committed: Mon May 16 04:21:20 2016 +0000

----------------------------------------------------------------------
 core/sql/executor/ExHbaseIUD.cpp | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
----------------------------------------------------------------------



[2/3] incubator-trafodion git commit: [TRAFODION-1971] Avoid redundant reinitialization during bulk load

Posted by se...@apache.org.
[TRAFODION-1971] Avoid redundant reinitialization during bulk load

After each flush during the preparation phase of bulk load, HFile
initialization was taking place redundantly. This imposed significant
overhead and slowed down loads.

Also removed comment regarding replacing init mechanism, in response
to review comment,


Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/90ab020b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/90ab020b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/90ab020b

Branch: refs/heads/master
Commit: 90ab020b30b6bbd102dcc9c3c7da294a6a9875e8
Parents: ad6f4ca
Author: Barry Fritchman <bl...@edev06.esgyn.local>
Authored: Fri May 13 20:23:36 2016 +0000
Committer: Barry Fritchman <bl...@edev06.esgyn.local>
Committed: Fri May 13 20:23:36 2016 +0000

----------------------------------------------------------------------
 core/sql/executor/ExHbaseIUD.cpp | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/90ab020b/core/sql/executor/ExHbaseIUD.cpp
----------------------------------------------------------------------
diff --git a/core/sql/executor/ExHbaseIUD.cpp b/core/sql/executor/ExHbaseIUD.cpp
index 44625dc..9553d53 100644
--- a/core/sql/executor/ExHbaseIUD.cpp
+++ b/core/sql/executor/ExHbaseIUD.cpp
@@ -1064,7 +1064,7 @@ ExHbaseAccessBulkLoadPrepSQTcb::ExHbaseAccessBulkLoadPrepSQTcb(
     hdfsSampleFile_(NULL),
     lastErrorCnd_(NULL)
 {
-   hFileParamsInitialized_ = false;  ////temporary-- need better mechanism later
+   hFileParamsInitialized_ = false;
    //sortedListOfColNames_ = NULL;
    posVec_.clear();