[I] [Feature Request]: Kafka Consumer to stop reading when idle (hop)

["mattcasters (via GitHub)" <gi...@apache.org>]

mattcasters opened a new issue, #7519:
URL: https://github.com/apache/hop/issues/7519

   ### What would you like to happen?
   
   Add an "max idle time" option.  The system would read messages from a topic and if none are received for a period, say 500ms, stop the consumer altogether, ending the Kafka reading pipeline.  
   We could also do a maximum number of messages read in a similar fashion.
   
   It would support the usecase of consuming all messages on the topic (for example) once per hour for batch processing by another process.
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: Transforms


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: Kafka Consumer to stop reading when idle (hop)

["hansva (via GitHub)" <gi...@apache.org>]

hansva closed issue #7519: [Feature Request]: Kafka Consumer to stop reading when idle
URL: https://github.com/apache/hop/issues/7519


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org