You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2017/03/16 14:47:41 UTC

[jira] [Created] (KYLIN-2512) Getting BufferUnderflowException from ConcurrentDiskStore

Shaofeng SHI created KYLIN-2512:
-----------------------------------

             Summary: Getting BufferUnderflowException from ConcurrentDiskStore
                 Key: KYLIN-2512
                 URL: https://issues.apache.org/jira/browse/KYLIN-2512
             Project: Kylin
          Issue Type: Bug
          Components: Job Engine
    Affects Versions: v1.6.0
            Reporter: Shaofeng SHI
            Assignee: liyang


Reported by 	rahulsingh <ra...@i-link.co.in> in mailing list:
getting this error while building a cube; Attached is the mock of the cube descriptor
{code}
org.apache.hadoop.mapred.YarnChild: Exception running child :
java.io.IOException: Failed to build cube in mapper 9
        at
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:148)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1714)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.util.concurrent.ExecutionException:
java.nio.BufferUnderflowException
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:188)
        at
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.nio.BufferUnderflowException
        at java.nio.Buffer.nextGetIndex(Buffer.java:492)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:135)
        at org.apache.kylin.common.util.BytesUtil.readVLong(BytesUtil.java:208)
        at org.apache.kylin.common.util.BytesUtil.readVInt(BytesUtil.java:223)
        at
org.apache.kylin.metadata.datatype.BigDecimalSerializer.peekLength(BigDecimalSerializer.java:83)
        at
org.apache.kylin.cube.gridtable.CubeCodeSystem.codeLength(CubeCodeSystem.java:91)
        at org.apache.kylin.gridtable.GTRecord.loadColumns(GTRecord.java:294)
        at
org.apache.kylin.cube.inmemcubing.ConcurrentDiskStore$Reader$2.hasNext(ConcurrentDiskStore.java:233)
        at
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$MergeSlot.fetchNext(DoggedCubeBuilder.java:412)
        at
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$Merger.mergeAndOutput(DoggedCubeBuilder.java:328)
        at
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:119)
        at
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:75)
        at
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)