[jira] [Commented] (KYLIN-4743) NPE when some kafka partition's offset is not exists in checkpoint

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17190629#comment-17190629 ] 

ASF GitHub Bot commented on KYLIN-4743:
---------------------------------------

coveralls edited a comment on pull request #1392:
URL: https://github.com/apache/kylin/pull/1392#issuecomment-686450407


   ## Pull Request Test Coverage Report for [Build 6337](https://coveralls.io/builds/33230516)
   
   * **0** of **6**   **(0.0%)**  changed or added relevant lines in **1** file are covered.
   * **7** unchanged lines in **4** files lost coverage.
   * Overall coverage increased (+**0.005%**) to **28.059%**
   
   ---
   
   |  Changes Missing Coverage | Covered Lines | Changed/Added Lines | % |
   | :-----|--------------|--------|---: |
   | [stream-source-kafka/src/main/java/org/apache/kylin/stream/source/kafka/consumer/KafkaConnector.java](https://coveralls.io/builds/33230516/source?filename=stream-source-kafka%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstream%2Fsource%2Fkafka%2Fconsumer%2FKafkaConnector.java#L87) | 0 | 6 | 0.0%
   <!-- | **Total:** | **0** | **6** | **0.0%** | -->
   
   |  Files with Coverage Reduction | New Missed Lines | % |
   | :-----|--------------|--: |
   | [stream-source-kafka/src/main/java/org/apache/kylin/stream/source/kafka/consumer/KafkaConnector.java](https://coveralls.io/builds/33230516/source?filename=stream-source-kafka%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstream%2Fsource%2Fkafka%2Fconsumer%2FKafkaConnector.java#L96) | 1 | 0% |
   | [tool/src/main/java/org/apache/kylin/tool/query/ProbabilityGenerator.java](https://coveralls.io/builds/33230516/source?filename=tool%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Ftool%2Fquery%2FProbabilityGenerator.java#L50) | 1 | 78.95% |
   | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/33230516/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% |
   | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/33230516/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L449) | 3 | 78.42% |
   <!-- | **Total:** | **7** |  | -->
   
   |  Totals | [![Coverage Status](https://coveralls.io/builds/33230516/badge)](https://coveralls.io/builds/33230516) |
   | :-- | --: |
   | Change from base [Build 6322](https://coveralls.io/builds/33179651): |  0.005% |
   | Covered Lines: | 26247 |
   | Relevant Lines: | 93542 |
   
   ---
   ##### 💛  - [Coveralls](https://coveralls.io)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> NPE when some kafka partition's offset is not exists in checkpoint
> ------------------------------------------------------------------
>
>                 Key: KYLIN-4743
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4743
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Real-time Streaming
>    Affects Versions: v3.0.0, v3.1.0
>         Environment: Centos 7.4.1
> hbase 1.2.4
> hive 2.0.1
> hadoop 2.7.2
>            Reporter: GuKe
>            Assignee: GuKe
>            Priority: Major
>             Fix For: Future
>
>         Attachments: WX20200903-153117.png
>
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> We have used streaming cube to statistics data from Kafka.
> If the data partitions of kafka topic is imbalanced (one or more partition is empty),it will cause the cube's checkpoint contains one or more partition's offset is empty.
> For some reason the receiver node be restarted,it will fail to initialization kafka connector because offset is null.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)