[jira] [Commented] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

["Daniel Barclay (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385966#comment-15385966 ] 

Daniel Barclay commented on SPARK-16652:
----------------------------------------

SPARK-3947 reports the same InternalError message that I saw in trimming down my test case for SPARK-16652, although the stack traces are much different.

> JVM crash from unsafe memory access for Dataset of class with List[Long]
> ------------------------------------------------------------------------
>
>                 Key: SPARK-16652
>                 URL: https://issues.apache.org/jira/browse/SPARK-16652
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.6.1, 1.6.2
>         Environment: Scala 2.10.<various>
> JDK: "Java HotSpot(TM) 64-Bit Server VM (build 25.74-b02, mixed mode)"
> MacOs 10.11.2
>            Reporter: Daniel Barclay
>         Attachments: UnsafeAccessCrashBugTest.scala
>
>
> Generating and writing out a {{Dataset}} of a class that has a {{List}} (or at least if it's {{List\[Long]}}) member and a {{String}} member causes a JVM crash.
> The crash seems to be related to unsafe memory access especially because earlier code (before I got it reduced to the current bug test case)  reported "{{java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code}}".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org