You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Wang Ken (JIRA)" <ji...@apache.org> on 2017/10/12 09:05:00 UTC

[jira] [Created] (KYLIN-2932) Simplify the thread model for in-memory cubing

Wang Ken created KYLIN-2932:
-------------------------------

             Summary: Simplify the thread model for in-memory cubing
                 Key: KYLIN-2932
                 URL: https://issues.apache.org/jira/browse/KYLIN-2932
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
    Affects Versions: v2.1.0
            Reporter: Wang Ken
            Assignee: Dong Li


The current implementation uses split threads, task threads and main thread to do the cube building, there is complex join and error handling logic.

The new implement leverages the ForkJoinPool from JDK,  the event split logic is handled in
main thread. Cuboid task and sub-tasks are handled in fork join pool, cube results are collected
async and can be write to output earlier.





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)