You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org> on 2009/10/30 05:20:59 UTC

[jira] Created: (HBASE-1945) Remove META and ROOT memcache size bandaid

Remove META and ROOT memcache size bandaid 
-------------------------------------------

                 Key: HBASE-1945
                 URL: https://issues.apache.org/jira/browse/HBASE-1945
             Project: Hadoop HBase
          Issue Type: Improvement
            Reporter: Jean-Daniel Cryans
             Fix For: 0.21.0


In 0.19 I introduced a bandaid to limit the damage done to losing the RS holding META or ROOT by drastically lowering the memstore size. Example: 

{code}
  public static final HTableDescriptor ROOT_TABLEDESC = new HTableDescriptor(
      HConstants.ROOT_TABLE_NAME,
      new HColumnDescriptor[] { new HColumnDescriptor(HConstants.CATALOG_FAMILY,
          10,  // Ten is arbitrary number.  Keep versions to help debuggging.
          Compression.Algorithm.NONE.getName(), false, true, 8 * 1024,
          HConstants.FOREVER, false) });
{code}

We can remove it from 0.21 since we force sync everything catalog.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1945) Remove META and ROOT memcache size bandaid

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771768#action_12771768 ] 

stack commented on HBASE-1945:
------------------------------

+1

> Remove META and ROOT memcache size bandaid 
> -------------------------------------------
>
>                 Key: HBASE-1945
>                 URL: https://issues.apache.org/jira/browse/HBASE-1945
>             Project: Hadoop HBase
>          Issue Type: Improvement
>            Reporter: Jean-Daniel Cryans
>             Fix For: 0.21.0
>
>
> In 0.19 I introduced a bandaid to limit the damage done to losing the RS holding META or ROOT by drastically lowering the memstore size. Example: 
> {code}
>   public static final HTableDescriptor ROOT_TABLEDESC = new HTableDescriptor(
>       HConstants.ROOT_TABLE_NAME,
>       new HColumnDescriptor[] { new HColumnDescriptor(HConstants.CATALOG_FAMILY,
>           10,  // Ten is arbitrary number.  Keep versions to help debuggging.
>           Compression.Algorithm.NONE.getName(), false, true, 8 * 1024,
>           HConstants.FOREVER, false) });
> {code}
> We can remove it from 0.21 since we force sync everything catalog.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1945) Remove META and ROOT memcache size bandaid

Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Daniel Cryans updated HBASE-1945:
--------------------------------------

    Description: 
In 0.19 I introduced a bandaid to limit the damage done to losing the RS holding META or ROOT by drastically lowering the memstore size. Example: 

{code}
  protected HTableDescriptor(final byte [] name, HColumnDescriptor[] families) {
    this.name = name.clone();
    this.nameAsString = Bytes.toString(this.name);
    setMetaFlags(name);
    for(HColumnDescriptor descriptor : families) {
      this.families.put(descriptor.getName(), descriptor);
    }
    setMemStoreFlushSize(16 * 1024);
  }
{code}

We can remove it from 0.21 since we force sync everything catalog.

  was:
In 0.19 I introduced a bandaid to limit the damage done to losing the RS holding META or ROOT by drastically lowering the memstore size. Example: 

{code}
  public static final HTableDescriptor ROOT_TABLEDESC = new HTableDescriptor(
      HConstants.ROOT_TABLE_NAME,
      new HColumnDescriptor[] { new HColumnDescriptor(HConstants.CATALOG_FAMILY,
          10,  // Ten is arbitrary number.  Keep versions to help debuggging.
          Compression.Algorithm.NONE.getName(), false, true, 8 * 1024,
          HConstants.FOREVER, false) });
{code}

We can remove it from 0.21 since we force sync everything catalog.


Changed the code in the description, wasn't showing the right piece.

> Remove META and ROOT memcache size bandaid 
> -------------------------------------------
>
>                 Key: HBASE-1945
>                 URL: https://issues.apache.org/jira/browse/HBASE-1945
>             Project: Hadoop HBase
>          Issue Type: Improvement
>            Reporter: Jean-Daniel Cryans
>             Fix For: 0.21.0
>
>
> In 0.19 I introduced a bandaid to limit the damage done to losing the RS holding META or ROOT by drastically lowering the memstore size. Example: 
> {code}
>   protected HTableDescriptor(final byte [] name, HColumnDescriptor[] families) {
>     this.name = name.clone();
>     this.nameAsString = Bytes.toString(this.name);
>     setMetaFlags(name);
>     for(HColumnDescriptor descriptor : families) {
>       this.families.put(descriptor.getName(), descriptor);
>     }
>     setMemStoreFlushSize(16 * 1024);
>   }
> {code}
> We can remove it from 0.21 since we force sync everything catalog.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HBASE-1945) Remove META and ROOT memcache size bandaid

Posted by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Daniel Cryans resolved HBASE-1945.
---------------------------------------

    Resolution: Fixed
      Assignee: Jean-Daniel Cryans

Removed the line in trunk.

> Remove META and ROOT memcache size bandaid 
> -------------------------------------------
>
>                 Key: HBASE-1945
>                 URL: https://issues.apache.org/jira/browse/HBASE-1945
>             Project: Hadoop HBase
>          Issue Type: Improvement
>            Reporter: Jean-Daniel Cryans
>            Assignee: Jean-Daniel Cryans
>             Fix For: 0.21.0
>
>
> In 0.19 I introduced a bandaid to limit the damage done to losing the RS holding META or ROOT by drastically lowering the memstore size. Example: 
> {code}
>   protected HTableDescriptor(final byte [] name, HColumnDescriptor[] families) {
>     this.name = name.clone();
>     this.nameAsString = Bytes.toString(this.name);
>     setMetaFlags(name);
>     for(HColumnDescriptor descriptor : families) {
>       this.families.put(descriptor.getName(), descriptor);
>     }
>     setMemStoreFlushSize(16 * 1024);
>   }
> {code}
> We can remove it from 0.21 since we force sync everything catalog.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.