Re: Topic Reassignment Tool Improvements

[Otis Gospodnetic <ot...@gmail.com>]

+1 for sticking this on the Wiki or in JIRA without your internal stuff and
letting those who need it (like us) clean up for inclusion.  We've got a
need for this, too. :)

Thanks,
Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/


On Wed, Apr 23, 2014 at 10:44 PM, Todd Palino <tp...@linkedin.com> wrote:

> We¹ve got a script that rebalances the partitions in a cluster based on
> their size (to try and keep the data size across the brokers even), which
> works very well for moving partitions onto new cluster members. The only
> problem with it is that it¹s got a couple hooks into our internal
> configuration system. We want to release it into the wild, but we need to
> fix that first so that the config it takes in is generic.
>
> I¹ll bug the SRE that wrote it to see if we can get that done sooner than
> later. Especially since we just talked about it at ApacheCon and said we
> would :)
>
> -Todd
>
>
> On 4/23/14, 7:37 PM, "Drew Goya" <dr...@gradientx.com> wrote:
>
> >Hey all, do you guys have any plans to enhance the topic reassignment
> >tool?
> > I've had to grow my cluster a couple times and getting an existing topics
> >partition replicas balanced out to the new brokers really sucks.  I have
> >to
> >describe the topic, awk the output to get it in the json format, then
> >manually edit that file.
> >
> >If no one takes a crack at it by the time I've got to expand my cluster
> >gain I'll probably give it a shot but hopefully it is already in the
> >works!
>
>