[GitHub] [druid] tijoparacka opened a new pull request #9583: Kinesis ingestion is getting reset because of time out.#9582

[GitBox <gi...@apache.org>]

tijoparacka opened a new pull request #9583: Kinesis ingestion is getting reset because of time out.#9582 
URL: https://github.com/apache/druid/pull/9583
 
 
   Kinesis ingestion is getting reset because of time out. After getting the new shard iterator the timeout is not updated. Because of this ingestion will fail .
   Fixes Task resting if there is no data coming to shard more that fetchSequenceNumberTimeout value.
   ### Description
   This issue will happen when there is no data coming to a shard for more than the timeout set in fetchSequenceNumberTimeout.
   AWS document mention that the timeout can be up to 5 min.
   
   The fix is to reset the timeout value after a new sharditerator is initialized
   ## Method modified
   KinesisRecordSupplier#getSequenceNumberInternal method is modified . 
   Kinesis-ingestion.md
   
   This PR has:
   - [ x] been self-reviewed.
   - [ x] added documentation for new or modified features or behaviors.
   
   ##### Key changed/added classes in this PR
    * `KinesisRecordSupplier`
    

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org