[GitHub] sjfink commented on issue #183: delegate sendMessage to the provider service

[gi...@git.apache.org]

sjfink commented on issue #183: delegate sendMessage to the provider service
URL: https://github.com/apache/incubator-openwhisk-package-kafka/issues/183#issuecomment-309753252
 
 
   You might be right -- I don't know the overhead of establishing an HTTP connection vs. a kafka connection.   I'd suggest doing an experiment and let's see what the numbers say. 
   
   Note that I suspect overhead on the message producer is the most important thing in most cases -- for asynchronous patterns the latency after it dispatches a message to kafka is likely less important.
   
   I think a higher-level claim is that we should think about a "real" solution that avoids establishing a new connection each time.     I realize this might be a  major, intrusive change to the system ... it might involve having some sort of "connection proxy" running on each invoker and a low-overhead low-latency communication channel to the proxy.    There are lots of engineering issues -- I haven't thought through the details.    I'm sure there are lots of implementation choices (grpc?).     Might be a research topic to figure out best way. 
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services