You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@ignite.apache.org by narges saleh <sn...@gmail.com> on 2021/01/13 21:34:49 UTC

rebalancing and jobs

Hi All,

What is the best practice regarding partition rebalancing and jobs?
1) Before I start a job, how do I check whether a rebalancing process is in
progress?
2) If no rebalancing is in progress, how do I delay or pause upcoming
rebalancing processes until my job is finished, assuming I don't want
to/can't use affinityrun/call? Is setting rebalanceDelay sufficient? I
don't want to do manual rebalancing.

thanks.

Re: rebalancing and jobs

Posted by akorensh <al...@gmail.com>.

Hi,
  You can monitor rebalance programmatically using JMX,
  
https://ignite.apache.org/docs/latest/monitoring-metrics/metrics#monitoring-rebalancing
   or events:
https://ignite.apache.org/docs/latest/events/events#cache-rebalancing-events
   and have your app react accordingly.


   You can set the rebalanceDelay property to have each rebalance job start
w/a delay.
   https://ignite.apache.org/docs/latest/data-rebalancing#other-properties

   A rebalance is usually triggered in response to discovery or cache
lifecycle events:
   https://ignite.apache.org/docs/latest/events/events#discovery-events
  
https://ignite.apache.org/docs/latest/events/events#cache-lifecycle-events

   Note that w/persistent clusters, rebalance is triggered when there is a
change in the
   baseline topology: https://ignite.apache.org/docs/latest/data-rebalancing

   There is not a way to delay an upcoming rebalancing job save for the
aforementioned rebalanceDelay property. The property will delay all
rebalance jobs a set number of milliseconds.

Thanks, Alex



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: rebalancing and jobs

Posted by narges saleh <sn...@gmail.com>.

To clarify, I do not want to pause rebalancing. I want to see if a
rebalancing job is in progress, delay my job and a rebalancing job is not
in progress, delay any upcoming rebalancing job, till my job is finished.

On Wed, Jan 13, 2021 at 5:04 PM narges saleh <sn...@gmail.com> wrote:

> Thanks Alex. I will study the links you provided. I need to deal with
> rebalancing programmatically.
>
> On Wed, Jan 13, 2021 at 4:33 PM akorensh <al...@gmail.com> wrote:
>
>> Hi,
>>   You can monitor using JMX as described here:
>>
>> https://ignite.apache.org/docs/latest/monitoring-metrics/metrics#monitoring-rebalancing
>>
>> you can also visually monitor rebalance via a special widget in control
>> center:
>>
>> https://www.gridgain.com/docs/control-center/latest/monitoring/configuring-widgets#rebalance-widget
>> https://ignite.apache.org/docs/latest/tools/gg-control-center
>>
>>    There is no way to manually pause the rebalancing process as it is
>> performed automatically in response to specific events. You can, however,
>> use config settings to delay the start of the rebalance process in
>> response
>> to nodes joining/leaving, change batch size, etc..
>> see: https://ignite.apache.org/docs/latest/data-rebalancing#throttling
>> https://ignite.apache.org/docs/latest/data-rebalancing#other-properties
>>
>>
>>   As an aside, this system view gives you a view into those properties:
>>
>> https://ignite.apache.org/docs/latest/monitoring-metrics/system-views#caches
>>
>> Thanks, Alex
>>
>>
>>
>> --
>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>
>

Re: rebalancing and jobs

Posted by narges saleh <sn...@gmail.com>.

Thanks Alex. I will study the links you provided. I need to deal with
rebalancing programmatically.

On Wed, Jan 13, 2021 at 4:33 PM akorensh <al...@gmail.com> wrote:

> Hi,
>   You can monitor using JMX as described here:
>
> https://ignite.apache.org/docs/latest/monitoring-metrics/metrics#monitoring-rebalancing
>
> you can also visually monitor rebalance via a special widget in control
> center:
>
> https://www.gridgain.com/docs/control-center/latest/monitoring/configuring-widgets#rebalance-widget
> https://ignite.apache.org/docs/latest/tools/gg-control-center
>
>    There is no way to manually pause the rebalancing process as it is
> performed automatically in response to specific events. You can, however,
> use config settings to delay the start of the rebalance process in response
> to nodes joining/leaving, change batch size, etc..
> see: https://ignite.apache.org/docs/latest/data-rebalancing#throttling
> https://ignite.apache.org/docs/latest/data-rebalancing#other-properties
>
>
>   As an aside, this system view gives you a view into those properties:
>
> https://ignite.apache.org/docs/latest/monitoring-metrics/system-views#caches
>
> Thanks, Alex
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: rebalancing and jobs

Posted by akorensh <al...@gmail.com>.

Hi,
  You can monitor using JMX as described here:
https://ignite.apache.org/docs/latest/monitoring-metrics/metrics#monitoring-rebalancing

you can also visually monitor rebalance via a special widget in control
center:
https://www.gridgain.com/docs/control-center/latest/monitoring/configuring-widgets#rebalance-widget
https://ignite.apache.org/docs/latest/tools/gg-control-center

   There is no way to manually pause the rebalancing process as it is
performed automatically in response to specific events. You can, however,
use config settings to delay the start of the rebalance process in response
to nodes joining/leaving, change batch size, etc..
see: https://ignite.apache.org/docs/latest/data-rebalancing#throttling
https://ignite.apache.org/docs/latest/data-rebalancing#other-properties


  As an aside, this system view gives you a view into those properties:
https://ignite.apache.org/docs/latest/monitoring-metrics/system-views#caches

Thanks, Alex



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/