You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org> on 2008/08/10 21:35:44 UTC
[jira] Created: (HBASE-813) Add a row counter in the new shell
Add a row counter in the new shell
----------------------------------
Key: HBASE-813
URL: https://issues.apache.org/jira/browse/HBASE-813
Project: Hadoop HBase
Issue Type: Improvement
Components: scripts
Affects Versions: 0.2.0
Reporter: Jean-Daniel Cryans
Assignee: Jean-Daniel Cryans
Priority: Minor
Fix For: 0.2.1, 0.3.0
Asked for in the thread "Any equivalence of HQL "select count..." in 0.2 shell?". Add a row counter in the new shell.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-813) Add a row counter in the new shell
Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jean-Daniel Cryans updated HBASE-813:
-------------------------------------
Attachment: hbase-813-v1.patch
Add the command "count" in the shell. Outputs the current number of rows and current row at each X rows, 1000 by default.
> Add a row counter in the new shell
> ----------------------------------
>
> Key: HBASE-813
> URL: https://issues.apache.org/jira/browse/HBASE-813
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: scripts
> Affects Versions: 0.2.0
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Priority: Minor
> Fix For: 0.2.1, 0.3.0
>
> Attachments: hbase-813-v1.patch
>
>
> Asked for in the thread "Any equivalence of HQL "select count..." in 0.2 shell?". Add a row counter in the new shell.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-813) Add a row counter in the new shell
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-813:
------------------------
Attachment: 813-v2.patch
I changed some of the text.
Also, the unfortunate thing about this patch is that the emitted count does not agree with the summary on the end. Here's what I saw:
{code}
....
Current count: 49214, row: 0000049213
Current count: 49236, row: 0000049235
Current count: 49258, row: 0000049257
Current count: 49280, row: 0000049279
08/08/11 19:41:23 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'TestTable,,1218483635305', STARTKEY => '', ENDKEY => '', ENCODED => 220058024, TABLE => {{NAME => 'TestTable', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'false'}]}}
49280 rows in table.
2241 row(s) in 21.4310 seconds
{code}
The 2241 is the count of times Formatter#row was called. We should make the two items align I'd say. Perhaps add an argument to Formatter#footer that alllows you force the total.
> Add a row counter in the new shell
> ----------------------------------
>
> Key: HBASE-813
> URL: https://issues.apache.org/jira/browse/HBASE-813
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: scripts
> Affects Versions: 0.2.0
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Priority: Minor
> Fix For: 0.2.1, 0.3.0
>
> Attachments: 813-v2.patch, hbase-813-v1.patch
>
>
> Asked for in the thread "Any equivalence of HQL "select count..." in 0.2 shell?". Add a row counter in the new shell.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-813) Add a row counter in the new shell
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-813.
-------------------------
Resolution: Fixed
Applied J-D's patch to branch and trunk (after adding reference to RowCounter mapreduce job to the count help).
> Add a row counter in the new shell
> ----------------------------------
>
> Key: HBASE-813
> URL: https://issues.apache.org/jira/browse/HBASE-813
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: scripts
> Affects Versions: 0.2.0
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Priority: Minor
> Fix For: 0.2.1, 0.3.0
>
> Attachments: 813-v2.patch, hbase-813-v1.patch, hbase-813-v3.patch
>
>
> Asked for in the thread "Any equivalence of HQL "select count..." in 0.2 shell?". Add a row counter in the new shell.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-813) Add a row counter in the new shell
Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jean-Daniel Cryans updated HBASE-813:
-------------------------------------
Attachment: hbase-813-v3.patch
Fixed the row count of footer.
> Add a row counter in the new shell
> ----------------------------------
>
> Key: HBASE-813
> URL: https://issues.apache.org/jira/browse/HBASE-813
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: scripts
> Affects Versions: 0.2.0
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Priority: Minor
> Fix For: 0.2.1, 0.3.0
>
> Attachments: 813-v2.patch, hbase-813-v1.patch, hbase-813-v3.patch
>
>
> Asked for in the thread "Any equivalence of HQL "select count..." in 0.2 shell?". Add a row counter in the new shell.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-813) Add a row counter in the new shell
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12621571#action_12621571 ]
stack commented on HBASE-813:
-----------------------------
Thinking on the Bily suggestion of emitting message every time we load a region, later, we might add this as an optional output format. When you specify an interval of 'regions', you get an emission which says how many rows in a region.
I'd say this latter suggestion low priority. Can do in a separate issue. One of us will make it doing a bit of debugging at sometime in the near future I'd imagine.
> Add a row counter in the new shell
> ----------------------------------
>
> Key: HBASE-813
> URL: https://issues.apache.org/jira/browse/HBASE-813
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: scripts
> Affects Versions: 0.2.0
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Priority: Minor
> Fix For: 0.2.1, 0.3.0
>
> Attachments: 813-v2.patch, hbase-813-v1.patch
>
>
> Asked for in the thread "Any equivalence of HQL "select count..." in 0.2 shell?". Add a row counter in the new shell.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.