[jira] [Closed] (KYLIN-1737) BufferOverflowException when calculate raw measure

["Shaofeng SHI (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shaofeng SHI closed KYLIN-1737.
-------------------------------

> BufferOverflowException when calculate raw measure
> --------------------------------------------------
>
>                 Key: KYLIN-1737
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1737
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v1.5.1
>         Environment: centos 6.5
>            Reporter: zhou degao
>            Assignee: Dong Li
>
> Input records: 6M+   (no this error if the input records is less than 3M)
> Error: java.nio.BufferOverflowException at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:189) at java.nio.ByteBuffer.put(ByteBuffer.java:859) at org.apache.kylin.common.util.BytesUtil.writeByteArray(BytesUtil.java:338) at org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:88) at org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:30) at org.apache.kylin.measure.MeasureCodec.encode(MeasureCodec.java:89) at org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:105) at org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:43) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)