You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "John Sichi (JIRA)" <ji...@apache.org> on 2010/06/02 03:39:38 UTC
[jira] Created: (HIVE-1383) allow HBase WAL to be disabled
allow HBase WAL to be disabled
------------------------------
Key: HIVE-1383
URL: https://issues.apache.org/jira/browse/HIVE-1383
Project: Hadoop Hive
Issue Type: Improvement
Components: HBase Handler
Affects Versions: 0.6.0
Reporter: John Sichi
Assignee: John Sichi
Fix For: 0.6.0
Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-1383:
-----------------------------
Status: Open (was: Patch Available)
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1383) allow HBase WAL to be disabled
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879850#action_12879850 ]
Ning Zhang commented on HIVE-1383:
----------------------------------
+1. Will commit if tests pass.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch, HIVE-1383.4.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Attachment: HIVE-1383.1.patch
Need to add a test; I'm just stashing this preliminary patch here so I don't lose it.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1383) allow HBase WAL to be disabled
Posted by "Jeff Hammerbacher (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875012#action_12875012 ]
Jeff Hammerbacher commented on HIVE-1383:
-----------------------------------------
Ignore the link to HBASE-1932--was a typo. Sorry about that, can't remove links.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Status: Patch Available (was: Open)
Latest patch is rebased against the commit for HIVE-1228.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875152#action_12875152 ]
John Sichi commented on HIVE-1383:
----------------------------------
To remove a link, click on the "Issue Links:" over to the left of the links; from there you can delete them.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Attachment: HIVE-1383.3.patch
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-1383:
-----------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
Committed. Thanks John!
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch, HIVE-1383.4.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Status: Open (was: Patch Available)
Just noticed that my testcase here conflicts with the one I added in HIVE-1228; I'll update it after HIVE-1228 gets committed.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1383) allow HBase WAL to be disabled
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876464#action_12876464 ]
Ning Zhang commented on HIVE-1383:
----------------------------------
I will take a look.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1383) allow HBase WAL to be disabled
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876480#action_12876480 ]
Ning Zhang commented on HIVE-1383:
----------------------------------
Looks good in general, except one nitpick: should we move HBASE_WAL_ENABLED = "hive.hbase.wal.enabled" to HiveConf.java and add an entry to hive-default.xml? It would be easier for users to browse all hive settings and their default values from a centralized conf file.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Attachment: HIVE-1383.4.patch
New patch with HiveConf changes.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch, HIVE-1383.4.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Status: Patch Available (was: Open)
Ning, can you take a look at this one?
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch, HIVE-1383.3.patch, HIVE-1383.4.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Attachment: HIVE-1383.2.patch
Added a testcase.
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1383) allow HBase WAL to be disabled
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1383:
-----------------------------
Status: Patch Available (was: Open)
> allow HBase WAL to be disabled
> ------------------------------
>
> Key: HIVE-1383
> URL: https://issues.apache.org/jira/browse/HIVE-1383
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: John Sichi
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1383.1.patch, HIVE-1383.2.patch
>
>
> Disabling WAL can lead to much better INSERT performance in cases where other means of safe recovery (such as bulk import) are available.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.