You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "XiaoXiang Yu (JIRA)" <ji...@apache.org> on 2019/06/09 11:16:00 UTC
[jira] [Comment Edited] (KYLIN-3997) Add a health check job of
Kylin
[ https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859431#comment-16859431 ]
XiaoXiang Yu edited comment on KYLIN-3997 at 6/9/19 11:15 AM:
--------------------------------------------------------------
Use this feature by add following if you are using 126.com:
{code:java}
kylin.job.notification-enabled=true
kylin.job.notification-mail-enable-starttls=true
kylin.job.notification-mail-host=smtp.126.com
kylin.job.notification-mail-username= hahaha@126.com
kylin.job.notification-mail-password=hahaha
kylin.job.notification-mail-sender=hahaha@126.com
kylin.job.notification-admin-emails=hahaha@kyligence.io,hahaha@126.com
{code}
After start the Kylin process, you should execute following command and get email received.
{code:java}
sh bin/kylin.sh org.apache.kylin.tool.KylinHealthCheckJob
{code}
You will receiver email like this :
{code}## Checking metadata
## Fix missing HDFS path of segments
## Checking HBase Table of segments
## Checking holes of Cubes
## Checking too many segments of Cubes
## Checking out-of-date Cubes
## Cleanup stopped job
{code}
was (Author: hit_lacus):
Use this feature by add following if you are using 126.com:
{code}
kylin.job.notification-enabled=true
kylin.job.notification-mail-enable-starttls=true
kylin.job.notification-mail-host=smtp.126.com
kylin.job.notification-mail-username= hahaha@126.com
kylin.job.notification-mail-password=hahaha
kylin.job.notification-mail-sender=hahaha@126.com
kylin.job.notification-admin-emails=hahaha@kyligence.io,hahaha@126.com
{code}
After start the Kylin process, you should execute following command and get email received.
{code}sh bin/kylin.sh org.apache.kylin.tool.KylinHealthCheckJob
{code}
> Add a health check job of Kylin
> -------------------------------
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
> Reporter: Liu Shaohui
> Assignee: Liu Shaohui
> Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be inconsistent for bugs or failures. It's better to have a a health check job to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)