[GitHub] vvraskin opened a new pull request #3552: Emit activation metadata to Kafka

[GitBox <gi...@apache.org>]

vvraskin opened a new pull request #3552: Emit activation metadata to Kafka
URL: https://github.com/apache/incubator-openwhisk/pull/3552
 
 
   <!--- Provide a concise summary of your changes in the Title -->
   
   ## Description
   <!--- Provide a detailed description of your changes. -->
   <!--- Include details of what problem you are solving and how your changes are tested. -->
   This PR enables sending activation metadata to Kafka, which might be helpful to alleviate the exertion of CouchDB we observe today as well as to preserve user activations metadata for real time processing. 
   
   At the moment I introduce a new kafka topic called `events` which will accept events of 2 types: Activations and Metrics. First corresponds to the metadata which is collected after an activation is finished (initTime, waitTime, responseCode, kind, etc), second stands for User related metrics of any kind (throttledActivations, concurrentActivations). The data is not aggregated, it is sent to Kafka instantly. 
   
   
   ## My changes affect the following components
   <!--- Select below all system components are affected by your change. -->
   <!--- Enter an `x` in all applicable boxes. -->
   - [ ] API
   - [x] Controller
   - [x] Message Bus (e.g., Kafka)
   - [ ] Loadbalancer
   - [x] Invoker
   - [ ] Intrinsic actions (e.g., sequences, conductors)
   - [ ] Data stores (e.g., CouchDB)
   - [ ] Tests
   - [ ] Deployment
   - [ ] CLI
   - [ ] General tooling
   - [ ] Documentation
   
   ## Types of changes
   <!--- What types of changes does your code introduce? Use `x` in all the boxes that apply: -->
   - [ ] Bug fix (generally a non-breaking change which closes an issue).
   - [x] Enhancement or new feature (adds new functionality).
   - [ ] Breaking change (a bug fix or enhancement which changes existing behavior).
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services