[GitHub] bjustin-ibm commented on issue #208: Add configurable "batch.size" property for feed subscriber

[gi...@git.apache.org]

bjustin-ibm commented on issue #208: Add configurable "batch.size" property for feed subscriber
URL: https://github.com/apache/incubator-openwhisk-package-kafka/issues/208#issuecomment-319540573
 
 
   @jthomas I'm having a hard time imagining this value getting set to something other than 1. I wonder if instead this ought to be a boolean named `batchMessages` with the default value being `true`, and when set `false` always fires the trigger with exactly one message.
   
   Implementing this should be trivial, but it needs to be excruciatingly clear to the user that because OpenWhisk trigger rate limits will typically be far lower than Kafka's typical rate of producing messages, limiting (or turning off) batching can conceivably result in the trigger falling hopelessly behind the current state of the topic - even to the point of completely missing messages that expire out of the topic before they are ever consumed by the feed.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services