[jira] [Created] (STORM-2184) New Kafka spout may fail to commit offsets on shutdown if polling thread is not blocked in poll when KafkaConsumer.wakeup is called

["Stig Rohde Døssing (JIRA)" <ji...@apache.org>]

Stig Rohde Døssing created STORM-2184:
-----------------------------------------

             Summary: New Kafka spout may fail to commit offsets on shutdown if polling thread is not blocked in poll when KafkaConsumer.wakeup is called
                 Key: STORM-2184
                 URL: https://issues.apache.org/jira/browse/STORM-2184
             Project: Apache Storm
          Issue Type: Bug
            Reporter: Stig Rohde Døssing
            Assignee: Stig Rohde Døssing
            Priority: Trivial


If a thread is blocking in one of a number of calls to KafkaConsumer and wakeup is called, the thread will throw WakeupException. If there is no such thread, the next call to one of the blocking methods will throw WakeupException instead.

The spout currently calls wakeup, then attempts to commit offsets to Kafka when shutting down. If there was no other thread to wake up (e.g. the async loop thread was doing something other than hanging in KakfaConsumer.poll), the call to KafkaConsumer.commitSync from the closing thread will throw WakeupException.

The thread running KafkaSpout.close shouldn't be interrupting itself, and should ignore WakeupExceptions when committing offsets.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)