You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "xubo245 (JIRA)" <ji...@apache.org> on 2018/11/27 07:04:00 UTC
[jira] [Commented] (CARBONDATA-3123) JVM crash when reading through
CarbonReader
[ https://issues.apache.org/jira/browse/CARBONDATA-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16699999#comment-16699999 ]
xubo245 commented on CARBONDATA-3123:
-------------------------------------
I can't reproduce the issue with the code, how to reproduce it?
> JVM crash when reading through CarbonReader
> -------------------------------------------
>
> Key: CARBONDATA-3123
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3123
> Project: CarbonData
> Issue Type: Bug
> Environment: Java - 1.8.0_40
> CPU(s): 8
> Cores(s): 8
> Reporter: Kunal Kapoor
> Assignee: Kunal Kapoor
> Priority: Major
> Fix For: 1.5.1
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> How to Reproduce:
>
> {code:java}
> // ExecutorService executorService = Executors.newFixedThreadPool(8);
> try {
> CarbonReader reader2 = CarbonReader.builder(dataDir).withRowRecordReader().build();
> List<CarbonReader> multipleReaders = reader2.split(8);
> try {
> List<ReadLogic> tasks = new ArrayList<>();
> List<Future> results = new ArrayList<>();
> count = 0;
> long start = System.currentTimeMillis();
> for (CarbonReader reader_i : multipleReaders) {
> results.add(executorService.submit(new ReadLogic(reader_i)));
> }
> for (Future result_i : results) {
> count += (long) result_i.get();
> }
> long end = System.currentTimeMillis();
> System.out.println("[Parallel read] Time: " + (end - start) + " ms");
> Assert.assertEquals(numFiles * numRowsPerFile, count);
> } catch (Exception e) {
> e.printStackTrace();
> Assert.fail(e.getMessage());
> }
> } catch (Exception e) {
> e.printStackTrace();
> Assert.fail(e.getMessage());
> } finally {
> executorService.shutdown();
> executorService.awaitTermination(10, TimeUnit.MINUTES);
> CarbonProperties.getInstance()
> .addProperty(CarbonCommonConstants.ENABLE_UNSAFE_IN_QUERY_EXECUTION, "false");
> }{code}
> When the above code is executed the JVM crashes with a SIGSEGV fault error.
> *ERROR:*
> {code:java}
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x00007f28b31aeb4f, pid=78614, tid=139809329497856
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_40-b26) (build 1.8.0_40-b26)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.40-b25 mixed mode linux-amd64 compressed oops)
> # Problematic frame:
> # C [libc.so.6+0x7bb4f] _int_malloc+0x2bf
> #
> # Core dump written. Default location: /opt/SDKReaderConcurrent/core or core.78614 (max size 1 kB). To ensure a full core dump, try "ulimit -c unlimited" before starting Java again
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.java.com/bugreport/crash.jsp
> #
> --------------- T H R E A D ---------------
> Current thread (0x000000000289b000): JavaThread "pool-1-thread-3" [_thread_in_vm, id=78852, stack(0x00007f27e55bc000,0x00007f27e56bd000)]
> siginfo: si_signo: 11 (SIGSEGV), si_code: 128 (SI_KERNEL), si_addr: 0x0000000000000000
> Registers:
> RAX=0x000000000001f411, RBX=0x145cc4c0145cc4c0, RCX=0x00007f2888000078, RDX=0x000000000001f410
> RSP=0x00007f27e56bae10, RBP=0x00007f27e56baf20, RSI=0x000000000001f400, RDI=0x00007f2888000020
> R8 =0x000000000001f400, R9 =0x00007f287b038ab8, R10=0x00007f28a2d1a738, R11=0x0000000000000000
> R12=0x00007f2888fb4f30, R13=0x000000000001f400, R14=0x0000000000000000, R15=0x0000000000000000
> RIP=0x00007f28b31aeb4f, EFLAGS=0x0000000000010216, CSGSFS=0x0000000000000033, ERR=0x0000000000000000
> TRAPNO=0x000000000000000d
> Top of Stack: (sp=0x00007f27e56bae10)
> 0x00007f27e56bae10: 00007f28a2a86e80 000000000001f430
> 0x00007f27e56bae20: 00007f2888000088 000000000001f400
> 0x00007f27e56bae30: 00007f2888000020 000000000001f410
> 0x00007f27e56bae40: 0000007a00000000 000000000289b000
> 0x00007f27e56bae50: 00007f27e56bae70 00007f28b23db276
> 0x00007f27e56bae60: 00007f28a2a86aed 00007f28a2a86aed
> 0x00007f27e56bae70: 00007f2888000078 00001f410289b000
> 0x00007f27e56bae80: 000000000289b000 00007f2888000020
> 0x00007f27e56bae90: 00007f27e56baf20 000000000001f400
> 0x00007f27e56baea0: 000000000001f400 0000000000000000
> 0x00007f27e56baeb0: 00007f27e56baf30 00007f28b31b11b7
> 0x00007f27e56baec0: 000000000289b000 00007f28b2ec9998
> 0x00007f27e56baed0: 00007f27e56baf20 000000000001f400
> 0x00007f27e56baee0: 000000000001f400 00007f28b2869445
> 0x00007f27e56baef0: 000000070289b000 00007f27e56baf30
> 0x00007f27e56baf00: 0000000000000007 000000000001f400
> 0x00007f27e56baf10: 00007f28b2efb6a0 000000000289b000
> 0x00007f27e56baf20: 00007f27e56baf80 00007f28b28696a3
> 0x00007f27e56baf30: 0000000000000000 0000000000000000
> 0x00007f27e56baf40: 0000000000000000 0000000000000000
> 0x00007f27e56baf50: 0000000000000000 000000000001f400
> 0x00007f27e56baf60: 00007f27e56bafc0 000000000289b000
> 0x00007f27e56baf70: 000000000001f400 00007f28b2effc00
> 0x00007f27e56baf80: 00007f27e56bafc0 00007f28b29e1e2b
> 0x00007f27e56baf90: 000000000289b000 000000074c19e5a0
> 0x00007f27e56bafa0: 00000005dc0ae7f0 0000000000000000
> 0x00007f27e56bafb0: 0000000000000006 00000007540c1fa8
> 0x00007f27e56bafc0: 00007f27e56bb010 00007f28a2d1a7a8
> 0x00007f27e56bafd0: 00000005dc0ae7f0 00007f28f803345b
> 0x00007f27e56bafe0: 00000005d5dfd558 00000006546e0b50
> 0x00007f27e56baff0: 0000000000000002 00007f28a2b87568
> 0x00007f27e56bb000: 0000000000000001 00007f2888085740
> Instructions: (pc=0x00007f28b31aeb4f)
> 0x00007f28b31aeb2f: f8 48 81 7c 24 28 ff 03 00 00 77 0b 48 39 5c 24
> 0x00007f28b31aeb3f: 60 0f 84 aa 01 00 00 48 8b 4c 24 60 48 89 59 18
> 0x00007f28b31aeb4f: 48 89 4b 10 48 39 54 24 28 0f 84 8a 04 00 00 48
> 0x00007f28b31aeb5f: 81 fa ff 03 00 00 0f 86 25 ff ff ff 48 89 d0 48
> Register to memory mapping:
> RAX=0x000000000001f411 is an unknown value
> RBX=0x145cc4c0145cc4c0 is an unknown value
> RCX=0x00007f2888000078 is an unknown value
> RDX=0x000000000001f410 is an unknown value
> RSP=0x00007f27e56bae10 is pointing into the stack for thread: 0x000000000289b000
> RBP=0x00007f27e56baf20 is pointing into the stack for thread: 0x000000000289b000
> RSI=0x000000000001f400 is an unknown value
> RDI=0x00007f2888000020 is an unknown value
> R8 =0x000000000001f400 is an unknown value
> R9 =0x00007f287b038ab8 is pointing into metadata
> R10=0x00007f28a2d1a738 is at entry_point+56 in (nmethod*)0x00007f28a2d1a590
> R11=0x0000000000000000 is an unknown value
> R12=0x00007f2888fb4f30 is an unknown value
> R13=0x000000000001f400 is an unknown value
> R14=0x0000000000000000 is an unknown value
> R15=0x0000000000000000 is an unknown value
> Stack: [0x00007f27e55bc000,0x00007f27e56bd000], sp=0x00007f27e56bae10, free space=1019k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
> C [libc.so.6+0x7bb4f] _int_malloc+0x2bf
> V [libjvm.so+0x9076a3] os::malloc(unsigned long, MemoryType)+0x73
> V [libjvm.so+0xa7fe2b] Unsafe_AllocateMemory+0x1db
> J 2094 sun.misc.Unsafe.allocateMemory(J)J (0 bytes) @ 0x00007f28a2d1a7a8 [0x00007f28a2d1a700+0xa8]
> J 2269 C1 org.apache.carbondata.core.memory.UnsafeMemoryManager.allocateMemory(Lorg/apache/carbondata/core/memory/MemoryType;Ljava/lang/String;J)Lorg/apache/carbondata/core/memory/MemoryBlock; (211 bytes) @ 0x00007f28a29747a4 [0x00007f28a2973680+0x1124]
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)