[jira] [Created] (KYLIN-2192) More Robust Global Dictionary

["Yerui Sun (JIRA)" <ji...@apache.org>]

Yerui Sun created KYLIN-2192:
--------------------------------

             Summary: More Robust Global Dictionary
                 Key: KYLIN-2192
                 URL: https://issues.apache.org/jira/browse/KYLIN-2192
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
    Affects Versions: v1.5.4.1
            Reporter: Yerui Sun
            Assignee: Yerui Sun
             Fix For: v1.6.0


Global dictionary have been released over 2 months, I've received some feedbacks and bug reports. Here's the patch to make global dictionary more robust, including some functional improvements.
* Break through 255 bytes limitation for value, but still recommend value length less than 8K, avoiding stack overflow error;
* Fix 'Value not exists' or stack overflow error when dict size is larger than 1GB, the root cause is similar with KYLIN-1834; A check tool also provided for check corrupted or not of existing dict data;
* Support parallel dictionary building in one job server, used for parallel segments building;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)