You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Chao Long <wa...@qq.com> on 2018/10/31 05:28:37 UTC

回复: why does MetadataCleanupJob set, NEW_RESOURCE_THREADSHOLD_MS=12hlimit ?

Hi you,
  What's you Kylin version?  this issue has been fixed in 2.5.0.
  https://issues.apache.org/jira/browse/KYLIN-3516




------------------ 原始邮件 ------------------
发件人: "you Zhuang"<zh...@gmail.com>;
发送时间: 2018年10月31日(星期三) 中午12:02
收件人: "user"<us...@kylin.apache.org>;

主题: Re: why does MetadataCleanupJob set, NEW_RESOURCE_THREADSHOLD_MS=12hlimit ?



Hi Shaofeng, when I discard an error build job, the web page does not refresh, I think which can make an improvement.

On Oct 31, 2018, at 9:24 AM, ShaoFeng Shi <sh...@apache.org> wrote:

Okay, thanks for the message, will update the document.

Alberto Ramón <a....@gmail.com> 于2018年10月31日周三 上午1:12写道:

I think this is done (but unodcumented)
 	 	
 Kylin 2602 v2.1, add job threshold
 

I used it, and works fine


On Tue, 30 Oct 2018 at 11:54, ShaoFeng Shi <sh...@apache.org> wrote:

That is just for safe I think. We can make it configurable so that user can customize it.

you Zhuang <zh...@gmail.com> 于2018年10月30日周二 下午5:06写道:

When I want to cleanup a repeatable error cube ,and then rebuild , dict error always occurs in build dict step, then I cleanup again and again ,the dict    
 
 Metadata is never be removed from meta table. I dive into source code , discover that MetadataCleanupJob only cleanup resources 12h before now.
 
 I think all resources not used can be removed excluding running build. But 12h does not actually do it.



-- 
Best regards,

Shaofeng Shi 史少锋






 
 



-- 
Best regards,

Shaofeng Shi 史少锋

Re: why does MetadataCleanupJob set, NEW_RESOURCE_THREADSHOLD_MS=12hlimit ?

Posted by you Zhuang <zh...@gmail.com>.
Refer to :  org.apache.kylin.rest.job.MetadataCleanupJob

Line 70:  
        long newResourceTimeCut = System.currentTimeMillis() - NEW_RESOURCE_THREADSHOLD_MS;


> On Oct 31, 2018, at 1:28 PM, Chao Long <wa...@qq.com> wrote:
> 
> Hi you,
>   What's you Kylin version?  this issue has been fixed in 2.5.0.
>   https://issues.apache.org/jira/browse/KYLIN-3516
> 
> 
> ------------------ 原始邮件 ------------------
> 发件人: "you Zhuang"<zh...@gmail.com>;
> 发送时间: 2018年10月31日(星期三) 中午12:02
> 收件人: "user"<us...@kylin.apache.org>;
> 主题: Re: why does MetadataCleanupJob set, NEW_RESOURCE_THREADSHOLD_MS=12hlimit ?
> 
> Hi Shaofeng, when I discard an error build job, the web page does not refresh, I think which can make an improvement.
> 
>> On Oct 31, 2018, at 9:24 AM, ShaoFeng Shi <shaofengshi@apache.org <ma...@apache.org>> wrote:
>> 
>> Okay, thanks for the message, will update the document.
>> 
>> Alberto Ramón <a.ramonportoles@gmail.com <ma...@gmail.com>> 于2018年10月31日周三 上午1:12写道:
>> I think this is done (but unodcumented)
>> Kylin 2602 <https://issues.apache.org/jira/browse/KYLIN-2602> v2.1, add job threshold
>> 
>> 
>> I used it, and works fine
>> 
>> On Tue, 30 Oct 2018 at 11:54, ShaoFeng Shi <shaofengshi@apache.org <ma...@apache.org>> wrote:
>> That is just for safe I think. We can make it configurable so that user can customize it.
>> 
>> you Zhuang <zhuangzixiaoyou@gmail.com <ma...@gmail.com>> 于2018年10月30日周二 下午5:06写道:
>> When I want to cleanup a repeatable error cube ,and then rebuild , dict error always occurs in build dict step, then I cleanup again and again ,the dict    
>> 
>> Metadata is never be removed from meta table. I dive into source code , discover that MetadataCleanupJob only cleanup resources 12h before now.
>> 
>> I think all resources not used can be removed excluding running build. But 12h does not actually do it.
>> 
>> 
>> -- 
>> Best regards,
>> 
>> Shaofeng Shi 史少锋
>> 
>> 
>> 
>> -- 
>> Best regards,
>> 
>> Shaofeng Shi 史少锋
>> 
>