You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Wang, Gang (JIRA)" <ji...@apache.org> on 2017/12/29 07:03:00 UTC

[jira] [Assigned] (KYLIN-3141) Support offset for segment merge

     [ https://issues.apache.org/jira/browse/KYLIN-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wang, Gang reassigned KYLIN-3141:
---------------------------------

       Assignee: Wang, Gang
    Component/s: Job Engine

> Support offset for segment merge
> --------------------------------
>
>                 Key: KYLIN-3141
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3141
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Job Engine
>            Reporter: Wang, Gang
>            Assignee: Wang, Gang
>            Priority: Minor
>
> This is a request to add an offset to the Kylin segment merge so as to avoid immediate merge of segments after a 7 day / 30 day window.
> Introducing a delay(offset) would help in 2 things -
> a) When auto merge kicks off I have a new segment and my daily incremental segment build script will fail because they won’t find the last segment.
> b) Lot of use cases where I may need to do data backfills for some of the days of the previous week, but I end up refreshing the whole merged segment instead of a day or two.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)