Plugging in libcrunch in Helix

[kishore g <g....@gmail.com>]

Hi,

Twitter recently open source libcrunch.
https://blog.twitter.com/2013/libcrunch-and-crush-maps. It uses the crush
algorithm to do the placement. It also takes care of rack aware placement.
I have looked at the code in detail. It will be nice to compare the
difference between what we have in Helix v/s this implementation. Here is
the code
https://github.com/twitter/libcrunch/tree/master/src/main/java/com/twitter/crunch

I think we should probably have a new module(helix-rebalancers) where we
plugin multiple rebalancers.

Thoughts?
thanks,
Kishore G

Re: Plugging in libcrunch in Helix

[kishore g <g....@gmail.com>]

+1
Yes, i think it will be a good idea to have a separate module where people
can plugin rebalancer's.


On Tue, Aug 6, 2013 at 8:04 AM, kishore g <g....@gmail.com> wrote:

> Hi,
>
> Twitter recently open source libcrunch.
> https://blog.twitter.com/2013/libcrunch-and-crush-maps. It uses the crush
> algorithm to do the placement. It also takes care of rack aware placement.
> I have looked at the code in detail. It will be nice to compare the
> difference between what we have in Helix v/s this implementation. Here is
> the code
> https://github.com/twitter/libcrunch/tree/master/src/main/java/com/twitter/crunch
>
> I think we should probably have a new module(helix-rebalancers) where we
> plugin multiple rebalancers.
>
> Thoughts?
> thanks,
> Kishore G
>
>
>