You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Alexander (Jira)" <ji...@apache.org> on 2020/10/30 11:53:00 UTC
[jira] [Updated] (KYLIN-4803) Hive Global Dictionary -
TopNMeasureType NullPointerException
[ https://issues.apache.org/jira/browse/KYLIN-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander updated KYLIN-4803:
-----------------------------
Attachment: spark_executor.log
> Hive Global Dictionary - TopNMeasureType NullPointerException
> -------------------------------------------------------------
>
> Key: KYLIN-4803
> URL: https://issues.apache.org/jira/browse/KYLIN-4803
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v3.1.1
> Reporter: Alexander
> Priority: Major
> Attachments: spark_executor.log
>
>
> I've read wiki article, and succesfully test it on count_distinct(bitmap)I've read wiki article, and succesfully test it on count_distinct(bitmap).
> When add measure like TOP_N, and have the same column.
> i.e.
> a. Measure BUYER_CNT_HLL - COUNT_DISTINCT Value:KYLIN_SALES.BUYER_ID, Type:column bitmap
> b. Measure TOP_SELLER - TOP_N SUM|ORDER BY:KYLIN_SALES.PRICE Group By:KYLIN_SALES.BUYER_ID topn(100,4)
> Then exception on step - Build Cube with Spark araise:
> {code:java}
> 20/10/30 07:33:11 ERROR executor.Executor: Exception in task 1.0 in stage 0.0 (TID 1)20/10/30 07:33:11 ERROR executor.Executor: Exception in task 1.0 in stage 0.0 (TID 1)java.lang.NullPointerException at org.apache.kylin.dimension.DictionaryDimEnc.<init>(DictionaryDimEnc.java:63) at org.apache.kylin.dimension.DictionaryDimEnc.<init>(DictionaryDimEnc.java:58) at org.apache.kylin.measure.topn.TopNMeasureType.getDimensionEncodings(TopNMeasureType.java:535) at org.apache.kylin.measure.topn.TopNMeasureType.access$200(TopNMeasureType.java:58) at org.apache.kylin.measure.topn.TopNMeasureType$1.valueOf(TopNMeasureType.java:146) at org.apache.kylin.measure.topn.TopNMeasureType$1.valueOf(TopNMeasureType.java:127) at org.apache.kylin.engine.mr.common.BaseCuboidBuilder.buildValueObjects(BaseCuboidBuilder.java:118)
> {code}
> It's because there is no dictionary for BUYER_ID
> In log file i see:
> Enable hive global dictionary for DEFAULT.KYLIN_SALES.BUYER_ID
> But in fact, TopNMeasureType: dictionaryMap do not have DEFAULT.KYLIN_SALES.BUYER_ID
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)