You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "qianqiaoneng (JIRA)" <ji...@apache.org> on 2016/03/16 09:02:33 UTC

[jira] [Created] (KYLIN-1500) streaming_fillgap cause out of memory

qianqiaoneng created KYLIN-1500:
-----------------------------------

             Summary: streaming_fillgap cause out of memory
                 Key: KYLIN-1500
                 URL: https://issues.apache.org/jira/browse/KYLIN-1500
             Project: Kylin
          Issue Type: Improvement
          Components: streaming
    Affects Versions: v1.2, v1.3.0
            Reporter: qianqiaoneng


streaming_fillgap.sh will try to fill gap when there is some error of the streaming job. But no matter how long the gap it is, how big the missing data it is, kylin tried to fill gap in one thread, which sometimes cause out of memory error. Need streaming_fillgap.sh to be more intelligent based on gap time range and data volume. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)