You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "nichunen (JIRA)" <ji...@apache.org> on 2019/02/25 08:03:00 UTC
[jira] [Created] (KYLIN-3828) ArrayIndexOutOfBoundsException thrown
when build a streaming cube with empty data in its first dimension
nichunen created KYLIN-3828:
-------------------------------
Summary: ArrayIndexOutOfBoundsException thrown when build a streaming cube with empty data in its first dimension
Key: KYLIN-3828
URL: https://issues.apache.org/jira/browse/KYLIN-3828
Project: Kylin
Issue Type: Bug
Components: NRT Streaming
Affects Versions: v2.6.0
Reporter: nichunen
Assignee: nichunen
Fix For: Future
The root cause is
in org.apache.kylin.source.kafka.hadoop.KafkaFlatTableMapper#doMap
{code:java}
public void doMap(LongWritable key, BytesWritable value, Context context) throws IOException, InterruptedException {
ByteBuffer buffer = ByteBuffer.wrap(value.getBytes(), 0, value.getLength());
StreamingMessageRow row = streamingParser.parse(buffer).get(0);
if (row == null) {
throw new IllegalArgumentException("");
}
data = StringUtil.join(row.getData(), delimiter);
// output this row to value
outValue.set(Bytes.toBytes(data));
context.write(outKey, outValue);
}
{code}
Method _StringUtil.join_ is used to join a collection of string to a single string with delimiter. But _org.apache.kylin.common.util.StringUtil#join_ will ignore the leading empty strings in the colletion, source code is:
{code:java}
public static String join(Iterable<String> parts, String separator) {
StringBuilder buf = new StringBuilder();
for (String p : parts) {
if (buf.length() > 0)
buf.append(separator);
buf.append(p);
}
return buf.toString();
}
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)