You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Davies Liu (JIRA)" <ji...@apache.org> on 2016/03/01 22:36:18 UTC
[jira] [Closed] (SPARK-10712) JVM crashes with
spark.sql.tungsten.enabled = true
[ https://issues.apache.org/jira/browse/SPARK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Davies Liu closed SPARK-10712.
------------------------------
Resolution: Cannot Reproduce
> JVM crashes with spark.sql.tungsten.enabled = true
> --------------------------------------------------
>
> Key: SPARK-10712
> URL: https://issues.apache.org/jira/browse/SPARK-10712
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.5.0
> Environment: 1 node - Linux, 64GB ram, 8 core
> Reporter: Mauro Pirrone
> Priority: Critical
>
> When turning on tungsten, I get the following error when executing a query/job with a few joins. When tungsten is turned off, the error does not appear. Also note that tungsten works for me in other cases.
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x00007ffadaf59200, pid=7598, tid=140710015645440
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_45-b14) (build 1.8.0_45-b14)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.45-b02 mixed mode linux-amd64 compressed oops)
> # Problematic frame:
> # V [libjvm.so+0x7eb200]
> #
> # Core dump written. Default location: //core or core.7598 (max size 1000000 kB). To ensure a full core dump, try "ulimit -c unlimited" before starting Java again
> #
> # An error report file with more information is saved as:
> # //hs_err_pid7598.log
> Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory (native)
> total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872
> relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72
> main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504
> Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory (native)
> total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872
> relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72
> main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.java.com/bugreport/crash.jsp
> #
> --------------- T H R E A D ---------------
> Current thread (0x00007ff7902e7800): JavaThread "broadcast-hash-join-1" daemon [_thread_in_vm, id=16548, stack(0x00007ff66bd98000,0x00007ff66be99000)]
> siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x000000069f572b10
> Registers:
> RAX=0x000000069f672b08, RBX=0x00007ff7902e7800, RCX=0x0000000394132140, RDX=0xfffffffffffe0004
> RSP=0x00007ff66be97048, RBP=0x00007ff66be970a0, RSI=0x0000000394032148, RDI=0x000000069f572b10
> R8 =0x00007ff66be970d0, R9 =0x0000000000000028, R10=0x00007ff79cc0e1e7, R11=0x00007ff79cc0e198
> R12=0x00007ff66be970c0, R13=0x00007ff66be970d0, R14=0x0000000000000028, R15=0x0000000030323048
> RIP=0x00007ff7b0dae200, EFLAGS=0x0000000000010282, CSGSFS=0x000000000000e033, ERR=0x0000000000000004
> TRAPNO=0x000000000000000e
> Top of Stack: (sp=0x00007ff66be97048)
> 0x00007ff66be97048: 00007ff7b1042b1a 00007ff7902e7800
> 0x00007ff66be97058: 00007ff700000000 00007ff7902e7800
> 0x00007ff66be97068: 00007ff7902e7800 00007ff7ad2846a0
> 0x00007ff66be97078: 00007ff7897048d8 0000000000000000
> 0x00007ff66be97088: 00007ff66be97110 00007ff66be971f0
> 0x00007ff66be97098: 00007ff7902e7800 00007ff66be970f0
> 0x00007ff66be970a8: 00007ff79cc0e261 0000000000100000
> 0x00007ff66be970b8: 0000000390c04048 000000066f24fac8
> 0x00007ff66be970c8: 00007ff7902e7800 0000000394032120
> 0x00007ff66be970d8: 00007ff7902e7800 00007ff66f971af0
> 0x00007ff66be970e8: 00007ff7902e7800 00007ff66be97198
> 0x00007ff66be970f8: 00007ff79c9d4c4d 00007ff66a454b10
> 0x00007ff66be97108: 00007ff79c9d4c4d 0000000000100000
> 0x00007ff66be97118: 00007ff7902e5a90 0000000000000028
> 0x00007ff66be97128: 00007ff79c9d4760 0000000394032120
> 0x00007ff66be97138: 0000000030323048 00007ff66be97160
> 0x00007ff66be97148: 000000066f24fac8 0000000390c04048
> 0x00007ff66be97158: 00007ff66be97158 00007ff66f978eeb
> 0x00007ff66be97168: 00007ff66be971f0 00007ff66f9791c8
> 0x00007ff66be97178: 00007ff668e90c60 00007ff66f978f60
> 0x00007ff66be97188: 00007ff66be97110 00007ff66be971b8
> 0x00007ff66be97198: 00007ff66be97238 00007ff79c9d4c4d
> 0x00007ff66be971a8: 0000000000100000 0000000000000000
> 0x00007ff66be971b8: 0000000038363130 0000000038363130
> 0x00007ff66be971c8: 0000000000000028 00007ff66f973388
> 0x00007ff66be971d8: 0000000394032120 0000000030323048
> 0x00007ff66be971e8: 0000000665823080 000000066f24fac8
> 0x00007ff66be971f8: 00007ff66be971f8 00007ff66f973357
> 0x00007ff66be97208: 00007ff66be97260 00007ff66f976fe0
> 0x00007ff66be97218: 0000000000000000 00007ff66f973388
> 0x00007ff66be97228: 00007ff66be971b8 00007ff66be97248
> 0x00007ff66be97238: 00007ff66be972a8 00007ff79c9d4c4d
> Instructions: (pc=0x00007ff7b0dae200)
> 0x00007ff7b0dae1e0: 00 00 00 48 8d 4c d6 f8 48 f7 da eb 39 48 8b 74
> 0x00007ff7b0dae1f0: d0 08 48 89 74 d1 08 48 83 c2 01 75 f0 c3 66 90
> 0x00007ff7b0dae200: 48 8b 74 d0 e8 48 89 74 d1 e8 48 8b 74 d0 f0 48
> 0x00007ff7b0dae210: 89 74 d1 f0 48 8b 74 d0 f8 48 89 74 d1 f8 48 8b
> Register to memory mapping:
> RAX=0x000000069f672b08 is an unallocated location in the heap
> RBX=0x00007ff7902e7800 is a thread
> RCX=0x0000000394132140 is pointing into object: 0x0000000394032120
> [B
> - klass: {type array byte}
> - length: 1886151312
> RDX=0xfffffffffffe0004 is an unknown value
> RSP=0x00007ff66be97048 is pointing into the stack for thread: 0x00007ff7902e7800
> RBP=0x00007ff66be970a0 is pointing into the stack for thread: 0x00007ff7902e7800
> RSI=0x0000000394032148 is pointing into object: 0x0000000394032120
> [B
> - klass: {type array byte}
> - length: 1886151312
> RDI=0x000000069f572b10 is an unallocated location in the heap
> R8 =0x00007ff66be970d0 is pointing into the stack for thread: 0x00007ff7902e7800
> R9 =0x0000000000000028 is an unknown value
> R10=0x00007ff79cc0e1e7 is at entry_point+103 in (nmethod*)0x00007ff79cc0e010
> R11=0x00007ff79cc0e198 is at entry_point+24 in (nmethod*)0x00007ff79cc0e010
> R12=0x00007ff66be970c0 is pointing into the stack for thread: 0x00007ff7902e7800
> R13=0x00007ff66be970d0 is pointing into the stack for thread: 0x00007ff7902e7800
> R14=0x0000000000000028 is an unknown value
> R15=0x0000000030323048 is an unknown value
> Stack: [0x00007ff66bd98000,0x00007ff66be99000], sp=0x00007ff66be97048, free space=1020k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
> V [libjvm.so+0x7eb200]
> J 8305 sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V (0 bytes) @ 0x00007ff79cc0e261 [0x00007ff79cc0e180+0xe1]
> j org.apache.spark.unsafe.Platform.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+27
> j org.apache.spark.unsafe.types.UTF8String.writeToMemory(Ljava/lang/Object;J)V+15
> j org.apache.spark.sql.catalyst.expressions.UnsafeRowWriters$UTF8StringWriter.write(Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;IILorg/apache/spark/unsafe/types/UTF8String;)I+48
> j org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Lorg/apache/spark/sql/catalyst/InternalRow;)Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;+160
> j org.apache.spark.sql.execution.joins.UnsafeHashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/UnsafeProjection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+39
> j org.apache.spark.sql.execution.joins.HashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/package$Projection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+18
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Lorg/apache/spark/broadcast/Broadcast;+88
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Ljava/lang/Object;+1
> j org.apache.spark.sql.execution.SQLExecution$.withExecutionId(Lorg/apache/spark/SparkContext;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;+20
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Lorg/apache/spark/broadcast/Broadcast;+22
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Ljava/lang/Object;+1
> j scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1()Lscala/util/Try;+8
> j scala.concurrent.impl.Future$PromiseCompletingRunnable.run()V+39
> j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
> j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
> j java.lang.Thread.run()V+11
> v ~StubRoutines::call_stub
> V [libjvm.so+0x681a26]
> V [libjvm.so+0x681f31]
> V [libjvm.so+0x6823d7]
> V [libjvm.so+0x718280]
> V [libjvm.so+0xa5c86f]
> V [libjvm.so+0xa5c99c]
> V [libjvm.so+0x910de8]
> C [libpthread.so.0+0x7a51]
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> J 8305 sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V (0 bytes) @ 0x00007ff79cc0e1e7 [0x00007ff79cc0e180+0x67]
> j org.apache.spark.unsafe.Platform.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+27
> j org.apache.spark.unsafe.types.UTF8String.writeToMemory(Ljava/lang/Object;J)V+15
> j org.apache.spark.sql.catalyst.expressions.UnsafeRowWriters$UTF8StringWriter.write(Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;IILorg/apache/spark/unsafe/types/UTF8String;)I+48
> j org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Lorg/apache/spark/sql/catalyst/InternalRow;)Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;+160
> j org.apache.spark.sql.execution.joins.UnsafeHashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/UnsafeProjection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+39
> j org.apache.spark.sql.execution.joins.HashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/package$Projection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+18
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Lorg/apache/spark/broadcast/Broadcast;+88
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Ljava/lang/Object;+1
> j org.apache.spark.sql.execution.SQLExecution$.withExecutionId(Lorg/apache/spark/SparkContext;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;+20
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Lorg/apache/spark/broadcast/Broadcast;+22
> j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Ljava/lang/Object;+1
> j scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1()Lscala/util/Try;+8
> j scala.concurrent.impl.Future$PromiseCompletingRunnable.run()V+39
> j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
> j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
> j java.lang.Thread.run()V+11
> v ~StubRoutines::call_stub
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org