You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@openwhisk.apache.org by GitBox <gi...@apache.org> on 2020/03/26 16:39:24 UTC
[GitHub] [openwhisk] HunderlineK opened a new issue #4869: Feature Request:
Implement an internal retry and DLQ mechanism
HunderlineK opened a new issue #4869: Feature Request: Implement an internal retry and DLQ mechanism
URL: https://github.com/apache/openwhisk/issues/4869
We're using OpenWhisk on IBM Cloud for streaming ETL and have implemented a custom retry mechanism as an ad-hoc addition to our pipeline. However, there's still a scenario where lack of internal retry means we are out of options: network failure at the machine running OpenWhisk.
If for whatever reason OpenWhisk cannot connect to any outside system, it becomes a black box that can only be investigated later by referring to log outputs. However, for security and practical reasons, using logs is not a feasible option for dealing with a high throughput system.
The only alternative is to validate the information from upstream services that pass data to OpenWhisk (in our case Kafka) to downstream services; e.g. having an external arbiter that checks to see if there is a successful event in the downstream services for every message in our upstream service. However, that is not practically feasible because downstream services can be e.g. SaaS products that are not controlled by us and do not expose the required information.
My proposal is for OpenWhisk to handle retry internally after a payload has been handed off to it and it has acknowledged receiving it.
Thanks
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [openwhisk] style95 commented on issue #4869: [Proposal] Internal
retry and DLQ mechanism
Posted by GitBox <gi...@apache.org>.
style95 commented on issue #4869: [Proposal] Internal retry and DLQ mechanism
URL: https://github.com/apache/openwhisk/issues/4869#issuecomment-604768576
@HunderlineK
This is a good idea.
While OpenWhisk only supports at-most-once semantic for some reason, it is still great to give options to users.
Why don't you create a POEM with this?
https://github.com/apache/openwhisk/tree/master/proposals
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services