You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ratis.apache.org by William Song <sz...@163.com> on 2022/10/11 12:00:47 UTC
Hot update on RaftServerConfigKeys
Hi,
We are trying to impose resource restrictions (mainly memory/network) on Ratis Server. However, configurations (such as bufferLimit of PendingRequests) in RaftServerConfigKeys are fixed after starting up and we cannot hot update them.
Consider the scenario: when we detect that a single group becomes the hotspot, we would like to increase its resource quota so that it can better serve the peak traffic. A workaround is that we can estimate the peak value and pre-allocate corresponding resource quote during start-up, but the extra resources are wasted during normal traffic. Also, the estimation may not always be accurate.
Is it possible to dynamically hot update the resource quota? Or are there other resolutions on above scenario?
Regards,
William
Re: Hot update on RaftServerConfigKeys
Posted by William Song <sz...@163.com>.
Hi Tsz-Wo,
I’ll check how HDFS supports reconfiguration in runtime. Filed an issue to track it: https://issues.apache.org/jira/browse/RATIS-1724 <https://issues.apache.org/jira/browse/RATIS-1724>.
William
> 2022年10月11日 23:08，Tsz Wo Sze <sz...@gmail.com> 写道：
>
> Hi William,
>
> It is a great idea to support hot updates! Recall that HDFS does support reconfiguration (hdfs dfsadmin -reconfig) to change configuration properties in runtime. We might have a similar approach.
>
> Tsz-Wo
>
>
> On Tue, Oct 11, 2022 at 8:01 PM William Song <szywilliam@163.com <ma...@163.com>> wrote:
> Hi,
>
> We are trying to impose resource restrictions (mainly memory/network) on Ratis Server. However, configurations (such as bufferLimit of PendingRequests) in RaftServerConfigKeys are fixed after starting up and we cannot hot update them.
>
> Consider the scenario: when we detect that a single group becomes the hotspot, we would like to increase its resource quota so that it can better serve the peak traffic. A workaround is that we can estimate the peak value and pre-allocate corresponding resource quote during start-up, but the extra resources are wasted during normal traffic. Also, the estimation may not always be accurate.
>
> Is it possible to dynamically hot update the resource quota? Or are there other resolutions on above scenario?
>
> Regards,
> William
>
>
Re: Hot update on RaftServerConfigKeys
Posted by Tsz Wo Sze <sz...@gmail.com>.
Hi William,
It is a great idea to support hot updates! Recall that HDFS does support
reconfiguration (hdfs dfsadmin -reconfig) to change configuration
properties in runtime. We might have a similar approach.
Tsz-Wo
On Tue, Oct 11, 2022 at 8:01 PM William Song <sz...@163.com> wrote:
> Hi,
>
> We are trying to impose resource restrictions (mainly memory/network) on
> Ratis Server. However, configurations (such as bufferLimit of
> PendingRequests) in RaftServerConfigKeys are fixed after starting up and we
> cannot hot update them.
>
> Consider the scenario: when we detect that a single group becomes the
> hotspot, we would like to increase its resource quota so that it can better
> serve the peak traffic. A workaround is that we can estimate the peak value
> and pre-allocate corresponding resource quote during start-up, but the
> extra resources are wasted during normal traffic. Also, the estimation may
> not always be accurate.
>
> Is it possible to dynamically hot update the resource quota? Or are there
> other resolutions on above scenario?
>
> Regards,
> William
>
>
>