[jira] [Commented] (SPARK-18451) Always set -XX:+HeapDumpOnOutOfMemoryError for Spark tests

["Xin Lu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-18451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223846#comment-16223846 ] 

Xin Lu commented on SPARK-18451:
--------------------------------

Pretty easy to do if we can get the jenkins job builder scripts changed and there is a place to dump the files on amplab jenkins/s3

> Always set -XX:+HeapDumpOnOutOfMemoryError for Spark tests
> ----------------------------------------------------------
>
>                 Key: SPARK-18451
>                 URL: https://issues.apache.org/jira/browse/SPARK-18451
>             Project: Spark
>          Issue Type: Bug
>          Components: Build, Tests
>            Reporter: Cheng Lian
>
> It would be nice if we always set {{-XX:+HeapDumpOnOutOfMemoryError}} and {{-XX:+HeapDumpPath}} for open source Spark tests. So that it would be easier to investigate issues like SC-5041.
> Note:
> - We need to ensure that the heap dumps are stored in a location on Jenkins that won't be automatically cleaned up.
> - It would be nice to be able to customize the customize the heap dump output paths on a per build basis so that it's easier to find the heap dump file of any given build.
> The 2nd point is optional since we can probably identify wanted heap dump files by looking at the creation timestamp.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org