You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2009/06/20 04:08:07 UTC

[jira] Created: (HBASE-1554) TestHeapSize failing on Hudson

TestHeapSize failing on Hudson
------------------------------

                 Key: HBASE-1554
                 URL: https://issues.apache.org/jira/browse/HBASE-1554
             Project: Hadoop HBase
          Issue Type: Bug
            Reporter: Andrew Purtell
            Priority: Critical
             Fix For: 0.20.0


TestHeapSize worked for me when tested locally but failing up on Hudson:

{code}
    [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
    [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
    [junit] 	class [B
    [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
    [junit] 	int
    [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
    [junit] 	int
    [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
    [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
    [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
{code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Re: [jira] Created: (HBASE-1554) TestHeapSize failing on Hudson

Posted by Erik Holstad <er...@gmail.com>.
Yeah!
I gets kinda nasty when it comes down to these test, but I guess I can add a
check to see if the system is 32 or 64 bits to the test.

Erik

Re: [jira] Created: (HBASE-1554) TestHeapSize failing on Hudson

Posted by Ryan Rawson <ry...@gmail.com>.
i bet hudson is using a 32-bit jvm....

-ryan

On Fri, Jun 19, 2009 at 7:08 PM, Andrew Purtell (JIRA) <ji...@apache.org>wrote:

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
>
> {code}
>    [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>    [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>    [junit]     class [B
>    [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>    [junit]     int
>    [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>    [junit]     int
>    [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147):
> Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2,
> refSize 4, size 32
>    [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>    [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>

[jira] Assigned: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Erik Holstad (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Erik Holstad reassigned HBASE-1554:
-----------------------------------

    Assignee: Erik Holstad

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Reopened: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell reopened HBASE-1554:
-----------------------------------


TestHeapSize is failing up on Hudson again.

http://hudson.zones.apache.org/hudson/job/HBase-Patch/678/changes
{noformat}
Failed

org.apache.hadoop.hbase.io.TestHeapSize.testSizes
Failing for the past 7 builds (Since Failed#672 )
Took 71 ms.
Error Message

expected:<88> but was:<14824>

Stacktrace

junit.framework.AssertionFailedError: expected:<88> but was:<14824>
	at org.apache.hadoop.hbase.io.TestHeapSize.testSizes(TestHeapSize.java:57)

Standard Error

2009-06-28 20:48:26,914 DEBUG [main] util.ClassSize(162): map
	class java.util.concurrent.ConcurrentHashMap
2009-06-28 20:48:26,916 DEBUG [main] util.ClassSize(162): evictionLock
	class java.util.concurrent.locks.ReentrantLock
2009-06-28 20:48:26,917 DEBUG [main] util.ClassSize(162): evictionInProgress
	boolean
2009-06-28 20:48:26,918 DEBUG [main] util.ClassSize(162): evictionThread
	class org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread
2009-06-28 20:48:26,918 DEBUG [main] util.ClassSize(162): scheduleThreadPool
	interface java.util.concurrent.ScheduledExecutorService
2009-06-28 20:48:26,919 DEBUG [main] util.ClassSize(162): size
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,919 DEBUG [main] util.ClassSize(162): elements
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,920 DEBUG [main] util.ClassSize(162): count
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,920 DEBUG [main] util.ClassSize(162): stats
	class org.apache.hadoop.hbase.io.hfile.LruBlockCache$CacheStats
2009-06-28 20:48:26,921 DEBUG [main] util.ClassSize(162): maxSize
	long
2009-06-28 20:48:26,921 DEBUG [main] util.ClassSize(162): blockSize
	long
2009-06-28 20:48:26,922 DEBUG [main] util.ClassSize(162): acceptableFactor
	float
2009-06-28 20:48:26,923 DEBUG [main] util.ClassSize(162): minFactor
	float
2009-06-28 20:48:26,923 DEBUG [main] util.ClassSize(162): singleFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): multiFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): memoryFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): overhead
	long
2009-06-28 20:48:26,925 DEBUG [main] util.ClassSize(188): Primitives 45, arrays 0, references(inlcuding 2, for object overhead) 10, refSize 4, size 88
{noformat}

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722123#action_12722123 ] 

Nitay Joffe commented on HBASE-1554:
------------------------------------

What about detecting 32 vs 64 bit jvm programatically in ClassSize? http://java.sun.com/docs/hotspot/HotSpotFAQ.html#64bit_detection


> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12725301#action_12725301 ] 

Jonathan Gray commented on HBASE-1554:
--------------------------------------

I actually didn't know my new block cache was going to get committed yet.  It was done and tested but I knew there was a heapsize issue with it.

There's a mismatch between how the LRU is tracking it's heap and how ClassSize is calculating it.

Since the LRU pre-allocates it's backing map, I include all of that overhead in the initial overhead of the LRU.  ClassSize does not consider that memory, only the reference to the map.

There are a large number of heapSize tests in the LRU unit tests, almost all of them at some point verify that it's properly keeping track of its size.  What is not done in those tests is verifying that the initial overhead/heapsize is perfectly aligned with the exact overhead of the object (and backing map).... However, since there is A) only one of these per regionserver, and B) the overhead from the Map is more than two orders of magnitude larger than the overhead of the LRU object itself... I don't think this is a particularly big deal.

I will work with Erik on figuring this out.  We should do _some_ kind of test that will ensure if we make changes to the LRU without updating the overhead, a unit test will fail.  That either means a special constructor, or a different style of unit test that does a deeper analysis.... maybe both.

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray updated HBASE-1554:
---------------------------------

    Attachment: HBASE-1554-v1.patch

Modified TestHeapSize to just test a static final from LruBlockCache that is used to calculate the overhead of the object itself.

Fixed that static final to be correct.

Test now passes.  I'm +1 on this being enough for heap size calculations for the lru.  The lru tests it's tracking of heapsize as it grows/shrinks, and this tests the baseline overhead of the object.

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12723719#action_12723719 ] 

stack commented on HBASE-1554:
------------------------------

Hey man, maybe wait till actually passes!

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray updated HBASE-1554:
---------------------------------

    Attachment: HBASE-1554-v2.patch

Adds additional tests in TestHeapSize for some of the native java types (and fixes their sizes to work).  Also adds a test for CachedBlock sizing.

Will open another issue to deal with "deep" sizing.

Tests pass for me now (32bit windows)... so please verify before commit on a real system :)

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch, HBASE-1554-v2.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1554:
----------------------------------

    Summary: ClassSize fails TestHeapSize and TestHFile on Hudson  (was: TestHeapSize failing on Hudson)

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray updated HBASE-1554:
---------------------------------

    Status: Patch Available  (was: Reopened)

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch, HBASE-1554-v2.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Erik Holstad (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722284#action_12722284 ] 

Erik Holstad commented on HBASE-1554:
-------------------------------------

All the issues are related to the fact that there is no place to set if you are running 32 or 64 bit machines at the moment and
this is needed for the test to pass.

The tests are done in Classsize, but not in HeapSize, so we just need to find a good place to put this and some smaller changes
to the tests and we should be good to go.

Erik

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray reassigned HBASE-1554:
------------------------------------

    Assignee: Jonathan Gray  (was: Erik Holstad)

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12725320#action_12725320 ] 

Jonathan Gray commented on HBASE-1554:
--------------------------------------

There's still a bit of a dissonance here, in that ClassSize calculates the overhead of a single object (and rather than the space of the objects within it, just the space to reference them).

I'm thinking what we really want is an additional ClassSize method like ClassSize.estimateFull() that includes the space of the objects beneath it.

I don't have very much time today or before the meetup tomorrow, so I'm going to throw up another patch that adds a few more checks in the style this currently works.  Will work on fancier stuff later in the week.

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1554:
----------------------------------

    Summary: TestHeapSize failing on Hudson  (was: ClassSize fails TestHeapSize and TestHFile on Hudson)

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12723704#action_12723704 ] 

Jonathan Gray commented on HBASE-1554:
--------------------------------------

Confirmed that this issue is one with HBASE-1562, will close once committed.

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12725005#action_12725005 ] 

Andrew Purtell edited comment on HBASE-1554 at 6/28/09 3:37 PM:
----------------------------------------------------------------

TestHeapSize is failing up on Hudson again.

http://hudson.zones.apache.org/hudson/job/HBase-Patch/678/testReport/

{noformat}
Failed

org.apache.hadoop.hbase.io.TestHeapSize.testSizes
Failing for the past 7 builds (Since Failed#672 )
Took 71 ms.
Error Message

expected:<88> but was:<14824>

Stacktrace

junit.framework.AssertionFailedError: expected:<88> but was:<14824>
	at org.apache.hadoop.hbase.io.TestHeapSize.testSizes(TestHeapSize.java:57)

Standard Error

2009-06-28 20:48:26,914 DEBUG [main] util.ClassSize(162): map
	class java.util.concurrent.ConcurrentHashMap
2009-06-28 20:48:26,916 DEBUG [main] util.ClassSize(162): evictionLock
	class java.util.concurrent.locks.ReentrantLock
2009-06-28 20:48:26,917 DEBUG [main] util.ClassSize(162): evictionInProgress
	boolean
2009-06-28 20:48:26,918 DEBUG [main] util.ClassSize(162): evictionThread
	class org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread
2009-06-28 20:48:26,918 DEBUG [main] util.ClassSize(162): scheduleThreadPool
	interface java.util.concurrent.ScheduledExecutorService
2009-06-28 20:48:26,919 DEBUG [main] util.ClassSize(162): size
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,919 DEBUG [main] util.ClassSize(162): elements
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,920 DEBUG [main] util.ClassSize(162): count
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,920 DEBUG [main] util.ClassSize(162): stats
	class org.apache.hadoop.hbase.io.hfile.LruBlockCache$CacheStats
2009-06-28 20:48:26,921 DEBUG [main] util.ClassSize(162): maxSize
	long
2009-06-28 20:48:26,921 DEBUG [main] util.ClassSize(162): blockSize
	long
2009-06-28 20:48:26,922 DEBUG [main] util.ClassSize(162): acceptableFactor
	float
2009-06-28 20:48:26,923 DEBUG [main] util.ClassSize(162): minFactor
	float
2009-06-28 20:48:26,923 DEBUG [main] util.ClassSize(162): singleFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): multiFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): memoryFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): overhead
	long
2009-06-28 20:48:26,925 DEBUG [main] util.ClassSize(188): Primitives 45, arrays 0, references(inlcuding 2, for object overhead) 10, refSize 4, size 88
{noformat}

      was (Author: apurtell):
    TestHeapSize is failing up on Hudson again.

http://hudson.zones.apache.org/hudson/job/HBase-Patch/678/changes
{noformat}
Failed

org.apache.hadoop.hbase.io.TestHeapSize.testSizes
Failing for the past 7 builds (Since Failed#672 )
Took 71 ms.
Error Message

expected:<88> but was:<14824>

Stacktrace

junit.framework.AssertionFailedError: expected:<88> but was:<14824>
	at org.apache.hadoop.hbase.io.TestHeapSize.testSizes(TestHeapSize.java:57)

Standard Error

2009-06-28 20:48:26,914 DEBUG [main] util.ClassSize(162): map
	class java.util.concurrent.ConcurrentHashMap
2009-06-28 20:48:26,916 DEBUG [main] util.ClassSize(162): evictionLock
	class java.util.concurrent.locks.ReentrantLock
2009-06-28 20:48:26,917 DEBUG [main] util.ClassSize(162): evictionInProgress
	boolean
2009-06-28 20:48:26,918 DEBUG [main] util.ClassSize(162): evictionThread
	class org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread
2009-06-28 20:48:26,918 DEBUG [main] util.ClassSize(162): scheduleThreadPool
	interface java.util.concurrent.ScheduledExecutorService
2009-06-28 20:48:26,919 DEBUG [main] util.ClassSize(162): size
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,919 DEBUG [main] util.ClassSize(162): elements
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,920 DEBUG [main] util.ClassSize(162): count
	class java.util.concurrent.atomic.AtomicLong
2009-06-28 20:48:26,920 DEBUG [main] util.ClassSize(162): stats
	class org.apache.hadoop.hbase.io.hfile.LruBlockCache$CacheStats
2009-06-28 20:48:26,921 DEBUG [main] util.ClassSize(162): maxSize
	long
2009-06-28 20:48:26,921 DEBUG [main] util.ClassSize(162): blockSize
	long
2009-06-28 20:48:26,922 DEBUG [main] util.ClassSize(162): acceptableFactor
	float
2009-06-28 20:48:26,923 DEBUG [main] util.ClassSize(162): minFactor
	float
2009-06-28 20:48:26,923 DEBUG [main] util.ClassSize(162): singleFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): multiFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): memoryFactor
	float
2009-06-28 20:48:26,924 DEBUG [main] util.ClassSize(162): overhead
	long
2009-06-28 20:48:26,925 DEBUG [main] util.ClassSize(188): Primitives 45, arrays 0, references(inlcuding 2, for object overhead) 10, refSize 4, size 88
{noformat}
  
> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HBASE-1554) ClassSize fails TestHeapSize and TestHFile on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray resolved HBASE-1554.
----------------------------------

    Resolution: Fixed

Fixed by commit of HBASE-1562

> ClassSize fails TestHeapSize and TestHFile on Hudson
> ----------------------------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Erik Holstad
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12725346#action_12725346 ] 

Jonathan Gray commented on HBASE-1554:
--------------------------------------

Filed HBASE-1590 for further work outside scope of this issue.

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch, HBASE-1554-v2.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-1554:
-------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed.  Thanks for patch Jon.

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch, HBASE-1554-v2.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12725310#action_12725310 ] 

Jonathan Gray commented on HBASE-1554:
--------------------------------------

Shoot, hold on commit.  Going to add unit test for CachedBlock.

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1554-v1.patch
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1554) TestHeapSize failing on Hudson

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722121#action_12722121 ] 

Andrew Purtell commented on HBASE-1554:
---------------------------------------

TestHFile is also failing, looks to be ClassSize related:

{code}
    [junit] Running org.apache.hadoop.hbase.io.hfile.TestHFile
    [junit] 2009-06-20 01:29:12,218 INFO  [main] hfile.TestHFile(121): writer=org.apache.hadoop.fs.FSDataOutputStream@
153f67e, compression=none
    [junit] 2009-06-20 01:29:12,250 INFO  [main] hfile.TestHFile(129): reader=org.apache.hadoop.fs.FSDataInputStream@
11671b2, compression=none, firstKey=0000000000, lastKey=0000000000, avgKeyLen=10, avgValueLen=10,
 entries=100, length=3738
    [junit] 2009-06-20 01:29:12,272 INFO  [main] hfile.TestHFile(121): writer=org.apache.hadoop.fs.FSDataOutputStream@
1a082e2, compression=gz
    [junit] 2009-06-20 01:29:12,301 WARN  [main] util.NativeCodeLoader(52): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    [junit] 2009-06-20 01:29:12,315 INFO  [main] hfile.TestHFile(129): reader=org.apache.hadoop.fs.FSDataInputStream@
176cad3, compression=gz, firstKey=0000000000, lastKey=0000000000, avgKeyLen=10, avgValueLen=10,
 entries=100, length=1224
    [junit] 2009-06-20 01:29:14,830 DEBUG [main] util.ClassSize(121): count
    [junit] 	int
    [junit] 2009-06-20 01:29:14,830 DEBUG [main] util.ClassSize(121): blockKeys
    [junit] 	class [[B
    [junit] 2009-06-20 01:29:14,831 DEBUG [main] util.ClassSize(121): blockOffsets
    [junit] 	class [J
    [junit] 2009-06-20 01:29:14,832 DEBUG [main] util.ClassSize(121): blockDataSizes
    [junit] 	class [I
    [junit] 2009-06-20 01:29:14,832 DEBUG [main] util.ClassSize(121): size
    [junit] 	int
    [junit] 2009-06-20 01:29:14,833 DEBUG [main] util.ClassSize(121): comparator
    [junit] 	interface org.apache.hadoop.io.RawComparator
    [junit] 2009-06-20 01:29:14,833 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 3, references(inlcuding 16, for object overhead) 3, refSize 4, size 72
    [junit] Tests run: 6, Failures: 1, Errors: 0, Time elapsed: 2.775 sec
    [junit] Test org.apache.hadoop.hbase.io.hfile.TestHFile FAILED
{code}

> TestHeapSize failing on Hudson
> ------------------------------
>
>                 Key: HBASE-1554
>                 URL: https://issues.apache.org/jira/browse/HBASE-1554
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.20.0
>
>
> TestHeapSize worked for me when tested locally but failing up on Hudson:
> {code}
>     [junit] Running org.apache.hadoop.hbase.io.TestHeapSize
>     [junit] 2009-06-20 01:29:11,577 DEBUG [main] util.ClassSize(121): bytes
>     [junit] 	class [B
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): offset
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,580 DEBUG [main] util.ClassSize(121): length
>     [junit] 	int
>     [junit] 2009-06-20 01:29:11,581 DEBUG [main] util.ClassSize(147): Primitives 8, arrays 1, references(inlcuding 16, for object overhead) 2, refSize 4, size 32
>     [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.181 sec
>     [junit] Test org.apache.hadoop.hbase.io.TestHeapSize FAILED
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.