You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "zhou degao (JIRA)" <ji...@apache.org> on 2016/05/26 02:15:12 UTC
[jira] [Created] (KYLIN-1737) BufferOverflowException when
calculate raw measure
zhou degao created KYLIN-1737:
---------------------------------
Summary: BufferOverflowException when calculate raw measure
Key: KYLIN-1737
URL: https://issues.apache.org/jira/browse/KYLIN-1737
Project: Kylin
Issue Type: Bug
Components: Job Engine
Affects Versions: v1.5.1
Environment: centos 6.5
Reporter: zhou degao
Assignee: Dong Li
Input records: 6M+ (no this error if the input records is less than 3M)
Error: java.nio.BufferOverflowException at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:189) at java.nio.ByteBuffer.put(ByteBuffer.java:859) at org.apache.kylin.common.util.BytesUtil.writeByteArray(BytesUtil.java:338) at org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:88) at org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:30) at org.apache.kylin.measure.MeasureCodec.encode(MeasureCodec.java:89) at org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:105) at org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:43) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)