[jira] [Commented] (KYLIN-2737) Change the dictionary building process to MR

["Zhong Yanghong (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-2737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158194#comment-16158194 ] 

Zhong Yanghong commented on KYLIN-2737:
---------------------------------------

Hi [~Shaofengshi], for [KYLIN-2217 | https://issues.apache.org/jira/browse/KYLIN-2217], the dictionary building process for fact table columns are moved to {{FactDistinctColumnsReducer}}. It can reduce some work of {{CreateDictionaryJob}}. 

However, in the step {{CreateDictionaryJob}}, it still needs to build dictionaries for columns of lookup tables which is as normal dimensions and to build snapshots for lookup tables. 

This JIRA is for changing the whole process to a MR job. Then use another step to just save the built dictionaries & snapshots.

> Change the dictionary building process to MR
> --------------------------------------------
>
>                 Key: KYLIN-2737
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2737
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>    Affects Versions: v2.2.0
>            Reporter: Zhong Yanghong
>            Assignee: Zhong Yanghong
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)