[jira] [Commented] (FLUME-3314) Flume kafka source/channel throws NPE when migrateOffsets() is called on nonexistent topics

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762577#comment-16762577 ] 

ASF subversion and git services commented on FLUME-3314:
--------------------------------------------------------

Commit 606eabb09997fa939735b5600f526a99895c350c in flume's branch refs/heads/trunk from turcsanyip
[ https://gitbox.apache.org/repos/asf?p=flume.git;h=606eabb ]

FLUME-3314 Fixed NPE in Kafka source/channel during offset migration (#276)

* FLUME-3314 Fixed NPE in Kafka source/channel during offset migration

Kafka source/channel threw NPE when migrateOffsets() was called
on nonexistent topics.
It has been fixed by adding null check and logging a warning message
(topic not found, skipping offset migration).

After skipping the offset migration, the source/channel works the same way
as the "non offset migration" case:
- starts and prints warning messages about the non-existing topic periodically
- can recover if the topic is created later

* FLUME-3314 Additional null checks.

Reviewers: Ferenc Szabo

(Peter Turcsanyi via Ferenc Szabo)

> Flume kafka source/channel throws NPE when migrateOffsets() is called on nonexistent topics
> -------------------------------------------------------------------------------------------
>
>                 Key: FLUME-3314
>                 URL: https://issues.apache.org/jira/browse/FLUME-3314
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: 1.8.0
>            Reporter: Peter Turcsanyi
>            Assignee: Peter Turcsanyi
>            Priority: Minor
>
> KafkaConsumer.partitionsFor(topicStr) returns null if the topic does not exist and auto.create.topics.enabled has been set to false on Kafka side.
> This case is not handled in the Flume code which leads to NPE.
> Null check needs to be added and warning message should be logged instead of the exception stacktrace.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org