You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Zhong Yanghong (JIRA)" <ji...@apache.org> on 2017/11/02 03:30:00 UTC
[jira] [Updated] (KYLIN-2986) Improve the way of parallel segment
building
[ https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhong Yanghong updated KYLIN-2986:
----------------------------------
Description:
Currently parallel segment building is allowed. However, there's few constraints, which may lead to several issues. For example:
# Two jobs for the same time range is triggered simultaneously, which is meaningless.
# There's overlap between segments to be build by parallel jobs
To avoid these issues, we should follow three rule checking:
# A new segment for a job should not have overlap with existing new segment
# A new segment for a job can have overlap with existing ready segments. However, it should cover them and its relative complement should be empty
was:
Currently parallel segment building is allowed. However, there's few constraints, which may lead to several issues. For example:
# Two jobs for the same time range is triggered simultaneously, which is meaningless.
> Improve the way of parallel segment building
> --------------------------------------------
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
> Issue Type: Improvement
> Reporter: Zhong Yanghong
> Assignee: Wang, Gang
>
> Currently parallel segment building is allowed. However, there's few constraints, which may lead to several issues. For example:
> # Two jobs for the same time range is triggered simultaneously, which is meaningless.
> # There's overlap between segments to be build by parallel jobs
> To avoid these issues, we should follow three rule checking:
> # A new segment for a job should not have overlap with existing new segment
> # A new segment for a job can have overlap with existing ready segments. However, it should cover them and its relative complement should be empty
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)