You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Jonathan Gray (JIRA)" <ji...@apache.org> on 2009/06/06 23:50:07 UTC

[jira] Commented: (HBASE-867) If millions of columns in a column family, hbase scanner won't come up

    [ https://issues.apache.org/jira/browse/HBASE-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716922#action_12716922 ] 

Jonathan Gray commented on HBASE-867:
-------------------------------------

Issue is probably resolved, but I'm going to continue testing.  It's not possible to create JUnit tests because the psuedo-distr. cluster falls over under load this high.

First simple test (gets though, not scans... scans next):

{noformat}
Generated 1 Puts in 3068ms
        1 rows, 8 bytes/row key
        1000000 columns/row, 8 bytes/column key
        8 bytes/column value
Inserted Put in 23295ms
Get0 (1000000 KVs) completed in 4031ms
Get1 (1000000 KVs) completed in 2300ms
Get2 (1000000 KVs) completed in 2831ms
Get3 (1000000 KVs) completed in 1707ms
Get4 (1000000 KVs) completed in 2588ms
Get5 (1000000 KVs) completed in 2671ms
Get6 (1000000 KVs) completed in 2442ms
Get7 (1000000 KVs) completed in 2560ms
Get8 (1000000 KVs) completed in 2462ms
Get9 (1000000 KVs) completed in 2822ms
{noformat}

> If millions of columns in a column family, hbase scanner won't come up
> ----------------------------------------------------------------------
>
>                 Key: HBASE-867
>                 URL: https://issues.apache.org/jira/browse/HBASE-867
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> Our Daniel has uploaded a table that has a column family with millions of columns in it.  He can get items from the table promptly specifying row and column.  Scanning is another matter.  Thread dumping I see we're stuck in the scanner constructor nexting through cells.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.