[GitHub] [incubator-druid] nishantmonu51 opened a new issue #8216: Add tier based usage metrics for historical nodes to help with druid historical autoscaling

[GitBox <gi...@apache.org>]

nishantmonu51 opened a new issue #8216: Add tier based usage metrics for historical nodes to help with druid historical autoscaling
URL: https://github.com/apache/incubator-druid/issues/8216
 
 
   ### Description
   Add tier based usage metrics for historical nodes to help druid cluster orchestration systems understand the historical node usage and requirements. Following metrics would be helpful - 
   * `datasource/required/capacity` - total capacity in bytes required to satisfy the replication factor in given tier. Dimensions - `tier`, `datasource`
   * `tier/required/capacity`- total capacity in bytes required in each tier. Dimensions - `tier`
   * `tier/total/capacity` - total capacity in bytes available in a given tier. Dimension - `tier`
   * `tier/historical/count` - no. of historical nodes available in each tier. Dimension - `tier`
   * `datasource/replication/factor` - configured maximum replication factor of a given datasource in given tier. Dimensions - `tier`, `datasource`
   
   ### Motivation
   
   The motivation is to add usage metrics to druid historical nodes to help define autoscaling strategies for Druid historical nodes. e.g writing a metrics based Horizontal Pod Autoscaler in Kubernetes cluster. 
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org