You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Ivan A. Veselovsky (JIRA)" <ji...@apache.org> on 2012/09/26 16:55:08 UTC
[jira] [Created] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Ivan A. Veselovsky created HADOOP-8851:
------------------------------------------
Summary: Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Key: HADOOP-8851
URL: https://issues.apache.org/jira/browse/HADOOP-8851
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ivan A. Veselovsky
Priority: Minor
This can help to reveal the cause of issue in the event of OOME in tests.
Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Posted by "Ivan A. Veselovsky (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ivan A. Veselovsky updated HADOOP-8851:
---------------------------------------
Attachment: HADOOP-8851-vs-trunk.patch
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463950#comment-13463950 ]
Hadoop QA commented on HADOOP-8851:
-----------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12546707/HADOOP-8851-vs-trunk.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in .
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1527//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1527//console
This message is automatically generated.
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8851:
-----------------------------------
Resolution: Fixed
Fix Version/s: 2.0.3-alpha
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I've just committed this to trunk and branch-2.
Thanks a lot for the contribution, Ivan.
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467091#comment-13467091 ]
Hudson commented on HADOOP-8851:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2820 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2820/])
HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky. (Revision 1392466)
Result = FAILURE
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1392466
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers reassigned HADOOP-8851:
--------------------------------------
Assignee: Ivan A. Veselovsky
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467012#comment-13467012 ]
Hudson commented on HADOOP-8851:
--------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2861 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2861/])
HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky. (Revision 1392466)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1392466
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Ivan A. Veselovsky (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466986#comment-13466986 ]
Ivan A. Veselovsky commented on HADOOP-8851:
--------------------------------------------
If you're using Jenkins (Hudson) builds, also it's good idea to save **/*.hprof artifacts to protect the memory dumps from being deleted upon the workspace cleanup.
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated HADOOP-8851:
----------------------------------------
Status: Patch Available (was: Open)
Submitting so precommit build runs
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467664#comment-13467664 ]
Hudson commented on HADOOP-8851:
--------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #392 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/392/])
svn merge -c 1392466 FIXES: HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky. (Revision 1392521)
Result = UNSTABLE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1392521
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-project/pom.xml
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha, 0.23.5
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467703#comment-13467703 ]
Hudson commented on HADOOP-8851:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk #1214 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1214/])
HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky. (Revision 1392466)
Result = FAILURE
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1392466
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha, 0.23.5
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466152#comment-13466152 ]
Aaron T. Myers commented on HADOOP-8851:
----------------------------------------
Hi Ivan, can you comment on what testing you've done of this patch? Did you perhaps modify a test to artificially induce an OOME and then observe that the heap dump showed up in the test output? For that matter, where does the heap dump show up? On the console? In some test output file?
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467688#comment-13467688 ]
Hudson commented on HADOOP-8851:
--------------------------------
Integrated in Hadoop-Hdfs-trunk #1183 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1183/])
HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky. (Revision 1392466)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1392466
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha, 0.23.5
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8851:
-----------------------------------
Component/s: test
Target Version/s: 2.0.3-alpha
Affects Version/s: 2.0.1-alpha
Thanks a lot for the info, Ivan, and for testing out the patch. I've also just tested out this option with OpenJDK and confirmed that it works similarly to the Sun JDK.
I'm going to go ahead and commit this shortly.
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8851) Use -XX:+HeapDumpOnOutOfMemoryError
JVM option in the forked tests
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated HADOOP-8851:
----------------------------------------
Fix Version/s: 0.23.5
I pulled this into branch-0.23 too
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha, 0.23.5
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467014#comment-13467014 ]
Hudson commented on HADOOP-8851:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #2798 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2798/])
HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky. (Revision 1392466)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1392466
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-project/pom.xml
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.1-alpha
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Fix For: 2.0.3-alpha
>
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Ivan A. Veselovsky (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466979#comment-13466979 ]
Ivan A. Veselovsky commented on HADOOP-8851:
--------------------------------------------
For example, add the following test:
/**
* Test to OOME: with the -XX:+HeapDumpOnOutOfMemoryError option the mem dump should be created by the JVM.
* @throws Exception
*/
public void testOOME() throws Exception {
final List<Object> list = new LinkedList<Object>();
while (true) {
Object placeHolder = new HashMap<Object,Object>();
list.add(placeHolder);
}
}
Typical output will look like the following:
-----
Running org.apache.hadoop.fs.permission.TestStickyBit
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid14838.hprof ...
Heap dump file created [1515333529 bytes in 21.641 secs]
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 85.68 sec <<< FAILURE!
-----
The heap dump (this is a huge binary file) will be named java_pid<process_pid>.hprof, and will be created by JVM in the current directory of the test run process (e.g. .../hadoop-common/hadoop-hdfs-project/hadoop-hdfs/ in my case). The heap dump can be opened and investigated with almost any profiler, including NetBeans.
Note, however, that the "-XX" ( http://www.oracle.com/technetwork/java/javase/tech/vmoptions-jsp-140102.html ) are HostSpot options, they may not work on other JVM implementations.
But, afaik, most of the testing is done on Orecle's JVMs 1.6.0_XX, so the option will work and will be helpful in case of OOME problems.
As experience shows, if there are no OOMEs, this option does not appear to introduce any problems or performance penalties.
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Assignee: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8851) Use
-XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
Posted by "Ivan A. Veselovsky (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464053#comment-13464053 ]
Ivan A. Veselovsky commented on HADOOP-8851:
--------------------------------------------
This is the change in pom.xml maven config, it should not require new or modified tests.
> Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests
> ------------------------------------------------------------------
>
> Key: HADOOP-8851
> URL: https://issues.apache.org/jira/browse/HADOOP-8851
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Ivan A. Veselovsky
> Priority: Minor
> Attachments: HADOOP-8851-vs-trunk.patch
>
>
> This can help to reveal the cause of issue in the event of OOME in tests.
> Suggested patch attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira