You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gora.apache.org by "stack (Created) (JIRA)" <ji...@apache.org> on 2012/04/06 23:48:15 UTC
[jira] [Created] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
-------------------------------------------------------------------------------------------
Key: GORA-114
URL: https://issues.apache.org/jira/browse/GORA-114
Project: Apache Gora
Issue Type: Improvement
Components: storage-hbase
Affects Versions: 0.2
Reporter: stack
Priority: Minor
In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249559#comment-13249559 ]
Hudson commented on GORA-114:
-----------------------------
Integrated in gora-trunk #219 (See [https://builds.apache.org/job/gora-trunk/219/])
Commit to address GORA-114 and update to CHANGES.txt. Thank you Stack. (Revision 1310996)
Result = SUCCESS
lewismc :
Files :
* /gora/trunk/CHANGES.txt
* /gora/trunk/gora-hbase/src/main/java/org/apache/gora/hbase/store/HBaseStore.java
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Fix For: 0.2
>
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "Ferdy Galema (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249566#comment-13249566 ]
Ferdy Galema commented on GORA-114:
-----------------------------------
Thanks for fixing this. This issue needs a small chance to the HBaseTableConnection. Please see GORA-115 for this.
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Fix For: 0.2
>
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated GORA-114:
-----------------------
Attachment: gora114.txt
A patch to read autoflush setting from Configuration. Also sets the default to be off so we batch up edits before flushing to the server.
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney closed GORA-114.
-------------------------------------
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Fix For: 0.2
>
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "Lewis John McGibbney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249221#comment-13249221 ]
Lewis John McGibbney commented on GORA-114:
-------------------------------------------
Hi Stack. Can you confirm if the bollean property would be included in hbase-site.xml? I am not so familiar with the configuration characteristics for HBase, but as far as I know this is the main configuration file. Thank you
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "Lewis John McGibbney (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lewis John McGibbney resolved GORA-114.
---------------------------------------
Resolution: Fixed
Fix Version/s: 0.2
Committed @ r1310996 in trunk. Thank you Stack. Please close this issue off when you have the time.
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Fix For: 0.2
>
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "Lewis John McGibbney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249523#comment-13249523 ]
Lewis John McGibbney commented on GORA-114:
-------------------------------------------
Absolutely I agree with this so thanks for opening the issue. It makes perfect sense to have this configurable. I'll add a short comment in the code to explain why the flush in configured so and where it can be configured from before I commit later today thank you very much.
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GORA-114) Make hbase autoflush default to false
and make autoflush configurable rather than hardcoded
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249421#comment-13249421 ]
stack commented on GORA-114:
----------------------------
bq. Can you confirm if the bollean property would be included in hbase-site.xml?
You'd include it only if you wanted to change the default.
You are correct that hbase-site.xml is where all of the customization of a particular instance go.
Anything else I can do to help this patch along Lewis? Any place you want me to put a bit of doc other than here in release note?
The patch comes of my trying the nice gora derivative, https://github.com/keith-turner/goraci, at Keith's suggestion (In his README he suggests this is needed and I agree with him).
Thanks.
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (GORA-114) Make hbase autoflush
default to false and make autoflush configurable rather than hardcoded
Posted by "Ferdy Galema (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/GORA-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249566#comment-13249566 ]
Ferdy Galema edited comment on GORA-114 at 4/8/12 3:47 PM:
-----------------------------------------------------------
Thanks for fixing this. This issue needs a small change to the HBaseTableConnection. Please see GORA-115 for this.
was (Author: ferdy.g):
Thanks for fixing this. This issue needs a small chance to the HBaseTableConnection. Please see GORA-115 for this.
> Make hbase autoflush default to false and make autoflush configurable rather than hardcoded
> -------------------------------------------------------------------------------------------
>
> Key: GORA-114
> URL: https://issues.apache.org/jira/browse/GORA-114
> Project: Apache Gora
> Issue Type: Improvement
> Components: storage-hbase
> Affects Versions: 0.2
> Reporter: stack
> Priority: Minor
> Fix For: 0.2
>
> Attachments: gora114.txt
>
>
> In gora trunk, its hard coded so hbase will flush from the client every individual edit. This makes it slow trying to load a bunch of data in via gora.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira