[GitHub] clintropolis opened a new pull request #6234: 'suspend' and 'resume' support for kafka indexing service

[GitBox <gi...@apache.org>]

clintropolis opened a new pull request #6234: 'suspend' and 'resume' support for kafka indexing service
URL: https://github.com/apache/incubator-druid/pull/6234
 
 
   changes:
   * introduces `SuspendableSupervisorSpec` interface to describe supervisors which support suspend/resume functionality controlled through the `SupervisorManager`, which will gracefully shutdown the supervisor and it's tasks, update it's `SupervisorSpec` with either a suspended or running state, and update with the toggled spec. Spec updates are provided by `SuspendableSupervisorSpec.createSuspendedSpec` and `SuspendableSupervisorSpec.createRunningSpec` respectively.
   * `KafkaSupervisorSpec` extends `SuspendableSupervisorSpec` and now supports suspend/resume functionality. The difference in behavior between 'running' and 'suspended' state is whether the supervisor will attempt to ensure that indexing tasks are or are not running respectively. Behavior is identical otherwise.
   * `SupervisorResource` now provides `/druid/indexer/v1/supervisor/{id}/suspend` and `/druid/indexer/v1/supervisor/{id}/resume` which are used to suspend/resume suspendable supervisors
   * Deprecated `/druid/indexer/v1/supervisor/{id}/shutdown` and moved it's functionality to `/druid/indexer/v1/supervisor/{id}/terminate` since 'shutdown' is ambiguous verbage for something that effectively stops a supervisor forever
   * Added ability to get all supervisor specs from `/druid/indexer/v1/supervisor` by supplying the 'full' query parameter `/druid/indexer/v1/supervisor?full` which will return a list of json objects of the form `{"id":<id>, "spec":<SupervisorSpec>}`
   * Updated overlord console ui to enable suspend/resume, and changed 'shutdown' to 'terminate'
   
   <img width="606" alt="screen shot 2018-08-24 at 5 03 44 pm" src="https://user-images.githubusercontent.com/1577461/44626025-6ff53080-a8ca-11e8-86e6-8d282d00d12e.png">
   
   <img width="607" alt="screen shot 2018-08-24 at 5 03 33 pm" src="https://user-images.githubusercontent.com/1577461/44626026-74b9e480-a8ca-11e8-8e47-b3b9de17e644.png">
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org