You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Lars Hofhansl (Created) (JIRA)" <ji...@apache.org> on 2011/12/08 07:01:45 UTC
[jira] [Created] (HBASE-4981) add raw scan support to shell
add raw scan support to shell
-----------------------------
Key: HBASE-4981
URL: https://issues.apache.org/jira/browse/HBASE-4981
Project: HBase
Issue Type: Sub-task
Components: shell
Affects Versions: 0.94.0
Reporter: Lars Hofhansl
Assignee: Lars Hofhansl
Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165526#comment-13165526 ]
stack commented on HBASE-4981:
------------------------------
This is sweet. I like passing attribute at same time. Then could have RAW => true and DEBUG => true. Issue I was talking of was HBASE-4981, a debug filter. I was thinking it would something like the following (assuming both RAW and DEBUG):
{code}
hbase(main):005:0> scan 'x1', {RAW=>true, VERSIONS=>10}
ROW COLUMN+CELL
r2 column=f:, timestamp=1323323616226, type=DeleteFamily
r2 column=f:c, timestamp=1323323617759, value=v3
r2 column=f:c, timestamp=1323323616226, value=v2
r2 column=f:c, timestamp=1323323614496, value=v1
r2 column=f:.values_skipped_returning_this_row, timestamp=1323323614496, value=20021
r2 column=f:.storefiles_in_this_family, timestamp=1323323614496, value=4
...
2 row(s) in 0.0500 seconds
{code}
i.e. we'd tag on some values on end of each row result that described things like number of storefiles in the cf, and how many values we skipped returning a row result (for example, if lots of deleted values skipped, would be nice to show that somehow)
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165027#comment-13165027 ]
stack commented on HBASE-4981:
------------------------------
+1
What'll you all it? raw_scan?
I want to add debug_scan and debug_get over in another issue. Not related are they?
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165979#comment-13165979 ]
Hudson commented on HBASE-4981:
-------------------------------
Integrated in HBase-TRUNK #2532 (See [https://builds.apache.org/job/HBase-TRUNK/2532/])
HBASE-4981 add raw scan support to shell (Lars H)
larsh :
Files :
* /hbase/trunk/src/main/ruby/hbase.rb
* /hbase/trunk/src/main/ruby/hbase/table.rb
* /hbase/trunk/src/main/ruby/shell/commands/scan.rb
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt, 4981-v3.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165590#comment-13165590 ]
stack commented on HBASE-4981:
------------------------------
+1
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165064#comment-13165064 ]
Lars Hofhansl commented on HBASE-4981:
--------------------------------------
Here's an example of what it would look like:
{noformat}
hbase(main):001:0> scan 'x2', {RAW=>true, VERSIONS=>10}
ROW COLUMN+CELL
r1 column=f:c, timestamp=1323323611106, value=v3
r1 column=f:c, timestamp=1323323609988, type=DeleteColumn
r1 column=f:c, timestamp=1323323609988, value=v2
r1 column=f:c, timestamp=1323323608554, value=v1
r2 column=f:c, timestamp=1323323617759, value=v3
r2 column=f:c, timestamp=1323323616226, value=v2
r2 column=f:c, timestamp=1323323614496, value=v1
2 row(s) in 0.6380 seconds
{noformat}
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl updated HBASE-4981:
---------------------------------
Attachment: 4981-v3.txt
Final change that was committed.
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt, 4981-v3.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl updated HBASE-4981:
---------------------------------
Attachment: 4981-v2.txt
Patch including help for scan command.
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165032#comment-13165032 ]
Lars Hofhansl commented on HBASE-4981:
--------------------------------------
Depends on what "debug_scan" means. The "raw" stuff I added in parent allow returning all KVs (including delete markers and deleted rows), is that what debug_scan does?
(Did a quick search, but couldn't find the issue you mentioned)
Was thinking about a syntax like RAW=>true as scan attribute. I.e.
scan 'table', {VERSIONS=>10, RAW=>true}
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl updated HBASE-4981:
---------------------------------
Attachment: 4981-v1.txt
Something like this.
(Note that the change from get_all_columns to [] is necessary, as "raw" scans only work when no columns are specified. The behavior is identical, in both cases the scan will show all columns)
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165364#comment-13165364 ]
Lars Hofhansl commented on HBASE-4981:
--------------------------------------
With a family delete marker:
{noformat}
hbase(main):005:0> scan 'x1', {RAW=>true, VERSIONS=>10}
ROW COLUMN+CELL
r2 column=f:, timestamp=1323323616226, type=DeleteFamily
r2 column=f:c, timestamp=1323323617759, value=v3
r2 column=f:c, timestamp=1323323616226, value=v2
r2 column=f:c, timestamp=1323323614496, value=v1
2 row(s) in 0.0500 seconds
{noformat}
Let me know what guys think, I think this is simple change and ready to go in.
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165540#comment-13165540 ]
Lars Hofhansl commented on HBASE-4981:
--------------------------------------
Nice! The debug option would be extremely helpful.
So I'll add the RAW stuff to the scan's help blurb, and then you'll continue in HBASE-4981?
Do I get a +1 here? :)
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165694#comment-13165694 ]
Lars Hofhansl commented on HBASE-4981:
--------------------------------------
bq. This is sweet. I like passing attribute at same time. Then could have RAW => true and DEBUG => true. Issue I was talking of was HBASE-4981, a debug filter.
Actually HBASE-4981 is this one :)... You mean HBASE-4926?
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt, 4981-v3.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165591#comment-13165591 ]
stack commented on HBASE-4981:
------------------------------
Oh, do you need to mention new facility in the Scan help for shell? If you can get it in, add on commit.
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166184#comment-13166184 ]
Hudson commented on HBASE-4981:
-------------------------------
Integrated in HBase-TRUNK-security #26 (See [https://builds.apache.org/job/HBase-TRUNK-security/26/])
HBASE-4981 add raw scan support to shell (Lars H)
larsh :
Files :
* /hbase/trunk/src/main/ruby/hbase.rb
* /hbase/trunk/src/main/ruby/hbase/table.rb
* /hbase/trunk/src/main/ruby/shell/commands/scan.rb
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt, 4981-v3.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-4981) add raw scan support to shell
Posted by "Lars Hofhansl (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl resolved HBASE-4981.
----------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Thanks for the review stack.
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt, 4981-v3.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4981) add raw scan support to shell
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165695#comment-13165695 ]
stack commented on HBASE-4981:
------------------------------
duh
> add raw scan support to shell
> -----------------------------
>
> Key: HBASE-4981
> URL: https://issues.apache.org/jira/browse/HBASE-4981
> Project: HBase
> Issue Type: Sub-task
> Components: shell
> Affects Versions: 0.94.0
> Reporter: Lars Hofhansl
> Assignee: Lars Hofhansl
> Fix For: 0.94.0
>
> Attachments: 4981-v1.txt, 4981-v2.txt, 4981-v3.txt
>
>
> Parent adds "raw" scan support to include delete markers and deleted rows in scan results. Would be nice it that would available in the shell to see exactly what exists in a table.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira