[GitHub] dgrove-oss opened a new pull request #2948: Programmatic lazy creation of completedN and invokerN topics

[GitBox <gi...@apache.org>]

dgrove-oss opened a new pull request #2948: Programmatic lazy creation of completedN and invokerN topics
URL: https://github.com/apache/incubator-openwhisk/pull/2948
 
 
   Each invoker and controller now ensures that their message topics are
   created as part of their individual startup procedure. As a result, we
   no longer need to eagerly create the topics during kafka startup
   to ensure the topics have the desired config parameters.
   
   This change is motivated by simplifying the deployment of OpenWhisk on
   Kubernetes, but also generally enables more dynamic sizing of the
   controller/invoker pools in any deployment.
   
   The change has four main parts:
     1. addition of the ensureTopic method to the MessagingProvider SPI
     2. bump of kafka version to 0.11.0.1 (required to get AdminClient API).
     3. implementation of ensureTopic for kafka using AdminClient
     4. Changes to controller and invoker code and deployment files to
        use the ensureTopic SPI method during startup.
   
   Note that although the various config parameters _may_ be overriden in
   the controller/invoker environment, defining the variables is not
   required. Defaults are defined that match the current ansible default
   values.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services