You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "GuKe (Jira)" <ji...@apache.org> on 2020/09/03 07:42:00 UTC

[jira] [Created] (KYLIN-4743) When the checkpoint of streming cube contains invalid offset (ex null) of Kafka partition,kafka connector will can't to open.

GuKe created KYLIN-4743:
---------------------------

             Summary: When the checkpoint of streming cube contains invalid offset (ex null) of Kafka partition,kafka connector will can't to open.
                 Key: KYLIN-4743
                 URL: https://issues.apache.org/jira/browse/KYLIN-4743
             Project: Kylin
          Issue Type: Improvement
          Components: Real-time Streaming
    Affects Versions: v3.1.0, v3.0.0
         Environment: Centos 7.4.1
hbase 1.2.4
hive 2.0.1
hadoop 2.7.2
            Reporter: GuKe
            Assignee: GuKe
             Fix For: Future
         Attachments: WX20200903-153117.png

We have used streaming cube to statistics data from Kafka.
If the data partitions of kafka topic is imbalanced (one or more partition is empty),it will cause the cube's checkpoint contains one or more partition's offset is empty.
For some reason the receiver node be restarted,it will fail to initialization kafka connector because offset is null.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)