You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by GitBox <gi...@apache.org> on 2020/07/03 04:03:43 UTC

[GitHub] [kylin] bigxiaochu commented on pull request #1298: KYLIN-4612 support job status writing to kafka

bigxiaochu commented on pull request #1298:
URL: https://github.com/apache/kylin/pull/1298#issuecomment-653331931


   @hit-lacus 我看了你提供的wiki，这个功能很好，输出metrics到kafka，再kylin自己消费掉生成实时系统cube。我后面会用到这个功能。非常感谢
   
   我这个是输出作业的状态变更到kafka，是给kylin用户消费用的。代替轮训作业列表，因为有上千个作业再运行的话，同时轮训的代价太大了。
   
   可以考虑共用一套写入kafka逻辑，但由于目的不一样，topic不一样，甚至由于公司有多套kafka集群，用的kafka集群可能也不一样，所以最好不要共用一套写入kafka逻辑，现有的KafkaReservoirReporter也是专门处理mertics的。


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org