You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "hongbin ma (JIRA)" <ji...@apache.org> on 2015/12/08 07:00:15 UTC

[jira] [Updated] (KYLIN-1210) Allowing segment overlap to solve streaming data completeness problem

     [ https://issues.apache.org/jira/browse/KYLIN-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

hongbin ma updated KYLIN-1210:
------------------------------
    Summary: Allowing segment overlap to solve streaming data completeness problem  (was: Allowing segment overlap to solve streaming data completeness)

> Allowing segment overlap to solve streaming data completeness problem
> ---------------------------------------------------------------------
>
>                 Key: KYLIN-1210
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1210
>             Project: Kylin
>          Issue Type: Improvement
>            Reporter: hongbin ma
>            Assignee: hongbin ma
>
> Previously cube segments in one cube are not allowed to overlap with each other. This constraint to more intuitive and simple to maintain. This constraint makes cube segments immutable, which is acceptable in batch cubing scenarios.
> In streaming cubing scenarios, however, there may exist late coming data due to upstream latencies. It's best we can still consume those late data rather than simply ignore it. To accomplish this we have to relief the above constraint.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)