You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@openjpa.apache.org by "Jeremy Bauer (JIRA)" <ji...@apache.org> on 2008/10/03 19:06:44 UTC

[jira] Created: (OPENJPA-737) Unit tests fail with OutOfMemoryException during build on Playstation 3

Unit tests fail with OutOfMemoryException during build on Playstation 3
-----------------------------------------------------------------------

                 Key: OPENJPA-737
                 URL: https://issues.apache.org/jira/browse/OPENJPA-737
             Project: OpenJPA
          Issue Type: Bug
          Components: build / infrastructure
    Affects Versions: 1.3.0
         Environment: Playstation 3, Yellow Dog Linux 6.0, IBM Java SDK 5.0 SR8a ppc64, 768mb swap space
            Reporter: Jeremy Bauer
            Priority: Minor


The OpenJPA build fails with an OutOfMemoryException on Playstation 3 while running unit tests.   I end up with a large core dump and other debug files.   The build is successful when I disable the unit tests.  Is there a way to run the build+unit tests on machines with limited memory (256mb core)?  

BTW, I have yet to get an OutOfMemoryException or javacore from Metal Gear Solid.  An OpenJPA build should be a piece of cake.  :-) :-)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (OPENJPA-737) Unit tests fail with OutOfMemoryException during build on Playstation 3

Posted by "Kevin Sutter (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OPENJPA-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636684#action_12636684 ] 

Kevin Sutter commented on OPENJPA-737:
--------------------------------------

Do your kids know that you are hijacking their machine for your development environment?  :-)

Are you running with the IBM JDK or the Sun JDK?  If you are running with the IBM JDK, you may  be hitting the issue I was having with the maven Release plugin.  Here's what I put out on our Release page ( http://cwiki.apache.org/confluence/display/openjpa/New+Release+Instructions+(BETA) ):

o  If using IBM JDK, then also set the system property test.jvm.arguments to -Xdump:none (Avoids OOM heap dumps on selected tests. These extra files throw off the rat:check processing.) For example,

     mvn -Dtest.jvm.arguments="-Xdump:none" ...

Or, you could switch to the Sun JDK...

Let us know if this was the cause of your problem.  OpenJPA has a testcase that forces OOM errors, so you just might be experiencing this situation.

Kevin



> Unit tests fail with OutOfMemoryException during build on Playstation 3
> -----------------------------------------------------------------------
>
>                 Key: OPENJPA-737
>                 URL: https://issues.apache.org/jira/browse/OPENJPA-737
>             Project: OpenJPA
>          Issue Type: Bug
>          Components: build / infrastructure
>    Affects Versions: 1.3.0
>         Environment: Playstation 3, Yellow Dog Linux 6.0, IBM Java SDK 5.0 SR8a ppc64, 768mb swap space
>            Reporter: Jeremy Bauer
>            Priority: Minor
>
> The OpenJPA build fails with an OutOfMemoryException on Playstation 3 while running unit tests.   I end up with a large core dump and other debug files.   The build is successful when I disable the unit tests.  Is there a way to run the build+unit tests on machines with limited memory (256mb core)?  
> BTW, I have yet to get an OutOfMemoryException or javacore from Metal Gear Solid.  An OpenJPA build should be a piece of cake.  :-) :-)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (OPENJPA-737) Unit tests fail with OutOfMemoryException during build on Playstation 3

Posted by "Jeremy Bauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OPENJPA-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12637094#action_12637094 ] 

Jeremy Bauer commented on OPENJPA-737:
--------------------------------------

I no longer get the core dump, but the build still fails with an OutOfMemoryException.  Here is the failure:

org.apache.maven.surefire.booter.SurefireExecutionException: org.apache.openjpa.persistence.kernel.TestTransition2; nested exception is java.lang.OutOfMemoryError: null; nested exception is org.apache.maven.surefire.testset.TestSetFailedException: org.apache.openjpa.persistence.kernel.TestTransition2; nested exception is java.lang.OutOfMemoryError: null
org.apache.maven.surefire.testset.TestSetFailedException: org.apache.openjpa.persistence.kernel.TestTransition2; nested exception is java.lang.OutOfMemoryError: null
java.lang.OutOfMemoryError
        at java.io.BufferedWriter.<init>(BufferedWriter.java:108)
        at java.io.BufferedWriter.<init>(BufferedWriter.java:91)
        at java.io.PrintStream.init(PrintStream.java:117)
        at java.io.PrintStream.<init>(PrintStream.java:134)
        at java.io.PrintStream.<init>(PrintStream.java:96)
        at org.apache.maven.surefire.util.TeeStream.<init>(TeeStream.java:35)
        at org.apache.maven.surefire.report.ReporterManager.testStarting(ReporterManager.java:278)
        at org.apache.maven.surefire.junit.TestListenerInvocationHandler.handleStartTest(TestListenerInvocationHandler.java:156)
        at org.apache.maven.surefire.junit.TestListenerInvocationHandler.invoke(TestListenerInvocationHandler.java:133)
        at $Proxy0.startTest(Unknown Source)
        at junit.framework.TestResult.startTest(TestResult.java:151)
        at junit.framework.TestResult.run(TestResult.java:103)
        at junit.framework.TestCase.run(TestCase.java:118)
        at org.apache.openjpa.persistence.test.PersistenceTestCase.run(PersistenceTestCase.java:143)
        at junit.framework.TestSuite.runTest(TestSuite.java:208)
        at junit.framework.TestSuite.run(TestSuite.java:203)
        at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:618)
        at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:213)
        at org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.executeTestSet(AbstractDirectoryTestSuite.java:140)
        at org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.execute(AbstractDirectoryTestSuite.java:127)
        at org.apache.maven.surefire.Surefire.run(Surefire.java:177)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:618)
        at org.apache.maven.surefire.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:334)
        at org.apache.maven.surefire.booter.SurefireBooter.main(SurefireBooter.java:980)
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------

Based on the build result, the OOME is not expected, but the test may be working with a very large data set.  
I'll take a look at the failing test to see if the OOME makes sense for this test in this type of environment.   I may also try the 32-bit SDK to see if that helps bring down memory usage (32-bit vs. 64-bit addresses).


> Unit tests fail with OutOfMemoryException during build on Playstation 3
> -----------------------------------------------------------------------
>
>                 Key: OPENJPA-737
>                 URL: https://issues.apache.org/jira/browse/OPENJPA-737
>             Project: OpenJPA
>          Issue Type: Bug
>          Components: build / infrastructure
>    Affects Versions: 1.3.0
>         Environment: Playstation 3, Yellow Dog Linux 6.0, IBM Java SDK 5.0 SR8a ppc64, 768mb swap space
>            Reporter: Jeremy Bauer
>            Priority: Minor
>
> The OpenJPA build fails with an OutOfMemoryException on Playstation 3 while running unit tests.   I end up with a large core dump and other debug files.   The build is successful when I disable the unit tests.  Is there a way to run the build+unit tests on machines with limited memory (256mb core)?  
> BTW, I have yet to get an OutOfMemoryException or javacore from Metal Gear Solid.  An OpenJPA build should be a piece of cake.  :-) :-)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (OPENJPA-737) Unit tests fail with OutOfMemoryException during build on Playstation 3

Posted by "Jeremy Bauer (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OPENJPA-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Bauer closed OPENJPA-737.
--------------------------------

      Assignee: Jeremy Bauer
    Resolution: Won't Fix

I spent a bit of time on this issue several weeks back.  I was able to get around the OOM and severe performance problems by:

* Upgrading to YDL 6.2 which include a kernel module to add a high priority 256M swap area mapped to high speed VRAM
* Adding a 2GB swap partition on an external USB 2.0 disk
* Using a remote MySQL database - eliminating disk I/O to a local Derby DB
* Using the 32-bit IBM SDK, which uses less heap

A build with jUnits was still terribly slow (20+ hours) due to the lack of core memory.  In addition, Sony recently pulled the plug on their "Other OS" support as of firmware rev 3.21.  While OpenJPA may prove to work fine within an application on this platform (pre-3.21 fw), it doesn't look to be a suitable for development.  Closing this JIRA.

> Unit tests fail with OutOfMemoryException during build on Playstation 3
> -----------------------------------------------------------------------
>
>                 Key: OPENJPA-737
>                 URL: https://issues.apache.org/jira/browse/OPENJPA-737
>             Project: OpenJPA
>          Issue Type: Bug
>          Components: build / infrastructure
>    Affects Versions: 1.3.0
>         Environment: Playstation 3, Yellow Dog Linux 6.0, IBM Java SDK 5.0 SR8a ppc64, 768mb swap space
>            Reporter: Jeremy Bauer
>            Assignee: Jeremy Bauer
>            Priority: Minor
>
> The OpenJPA build fails with an OutOfMemoryException on Playstation 3 while running unit tests.   I end up with a large core dump and other debug files.   The build is successful when I disable the unit tests.  Is there a way to run the build+unit tests on machines with limited memory (256mb core)?  
> BTW, I have yet to get an OutOfMemoryException or javacore from Metal Gear Solid.  An OpenJPA build should be a piece of cake.  :-) :-)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (OPENJPA-737) Unit tests fail with OutOfMemoryException during build on Playstation 3

Posted by "Jeremy Bauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OPENJPA-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636695#action_12636695 ] 

Jeremy Bauer commented on OPENJPA-737:
--------------------------------------

Thanks, Kevin.

My development environment?  ...it was the kids that found the problem.  I told them that when they get a little older they could get their very own JIRA account.  :-) 

Seriously, though.  I'll give the JVM arg a shot and let you know if it fixes the problem.

> Unit tests fail with OutOfMemoryException during build on Playstation 3
> -----------------------------------------------------------------------
>
>                 Key: OPENJPA-737
>                 URL: https://issues.apache.org/jira/browse/OPENJPA-737
>             Project: OpenJPA
>          Issue Type: Bug
>          Components: build / infrastructure
>    Affects Versions: 1.3.0
>         Environment: Playstation 3, Yellow Dog Linux 6.0, IBM Java SDK 5.0 SR8a ppc64, 768mb swap space
>            Reporter: Jeremy Bauer
>            Priority: Minor
>
> The OpenJPA build fails with an OutOfMemoryException on Playstation 3 while running unit tests.   I end up with a large core dump and other debug files.   The build is successful when I disable the unit tests.  Is there a way to run the build+unit tests on machines with limited memory (256mb core)?  
> BTW, I have yet to get an OutOfMemoryException or javacore from Metal Gear Solid.  An OpenJPA build should be a piece of cake.  :-) :-)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.