You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by 徐增强 <xu...@163.com> on 2019/04/24 10:56:18 UTC

RBF forwards Rpc to slower NS

Hi,


As we all known, One Router can forward Rpc to some name services. 
In the scenario with Router high QPS,  if one running NS slow down for some reason(like GC, network delays, packet loss etc), 
the slower NS will consume all handlers in Router. And the Router will no ability to forward Rpc to other normal NS.


Like this:
 - Router forward Rpcs to NS1 and NS2.
 - At some time,  NS2 occur full GC, and the Rpc from Router to NS2 will be blocked in Router.
 - Some other clients ask this Router to forward Rpc to NS2, and they all will be blocked in Router.
 - As above all handlers in Router will be blocked to forward Rpc to NS2.
 - Some other clients will failed to ask this Router to forward Rpc to NS1 because there is no free handler in Router to forward this Rpc.


Someone has some ideas to fix this case?


Thanks for your help,
Best regards

Re: RBF forwards Rpc to slower NS

Posted by Chao Sun <su...@apache.org>.

Hi, this is tracked by https://issues.apache.org/jira/browse/HDFS-14090,
you are welcome to participate in the discussion there.

Chao

On Fri, Apr 26, 2019 at 10:09 AM 徐增强 <xu...@163.com> wrote:

> Hi,
>
> As we all known, One Router can forward Rpc to some name services.
> In the scenario with Router high QPS,  if one running NS slow down for
> some reason(like GC, network delays, packet loss etc),
> the slower NS will consume all handlers in Router. And the Router will no
> ability to forward Rpc to other normal NS.
>
> Like this:
>  - Router forward Rpcs to NS1 and NS2.
>  - At some time,  NS2 occur full GC, and the Rpc from Router to NS2 will
> be blocked in Router.
>  - Some other clients ask this Router to forward Rpc to NS2, and they all
> will be blocked in Router.
>  - As above all handlers in Router will be blocked to forward Rpc to NS2.
>  - Some other clients will failed to ask this Router to forward Rpc to NS1
> because there is no free handler in Router to forward this Rpc.
>
> Someone has some ideas to fix this case?
>
> Thanks for your help,
> Best regards
>
>
>
>
>