[GitHub] [incubator-druid] akashdw opened a new issue #4665: Ability to blacklist historical node

[GitBox <gi...@apache.org>]

akashdw opened a new issue #4665: Ability to blacklist historical node
URL: https://github.com/apache/incubator-druid/issues/4665
 
 
   We had an issue where some historical nodes(with root partition filled up with the request logs) were not able to download segments and coordinator was keep assigning new segments to those historical nodes.
   It would be nice if coordinator can blacklist historical nodes.
    
   Blacklisting could be based on segment download status. Currently historical nodes don't pass segment load success/fail information to coordinator, in both cases historical deletes the loadQueue for the segment. Passing segment load status to coordinator will be useful to figure out if the problem is with the segment itself(say broken deep storage path) or with the historical node (disk issues), if it is with historical then blacklist historical node. 
   
   Haven't figured out the full details of the above approach and open for suggestions. what do you think @gianm @cheddar @himanshug @leventov ?
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org