You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Brennon Church <br...@getjar.com> on 2013/01/17 18:54:06 UTC

Throttle replication speed in case of datanode failure

Hello,

Is there a way to throttle the speed at which under-replicated blocks 
are copied across a cluster?  Either limiting the bandwidth or the 
number of blocks per time period would work.

I'm currently running Hadoop v1.0.1.  I think the 
dfs.namenode.replication.work.multiplier.per.iteration option would do 
the trick, but that is in v1.1.0 and higher.

Thanks.

--Brennon

Re: Throttle replication speed in case of datanode failure

Posted by Brennon Church <br...@getjar.com>.
Ack.  Sorry about that guys.  Need to pay more attention when I email.

--Brennon

On 1/17/13 10:03 AM, Jean-Daniel Cryans wrote:
> Since this is a Hadoop question, it should be sent
> user@hadoop.apache.org (which I'm now sending this to and I put
> user@hbase in BCC).
>
> J-D
>
> On Thu, Jan 17, 2013 at 9:54 AM, Brennon Church <br...@getjar.com> wrote:
>> Hello,
>>
>> Is there a way to throttle the speed at which under-replicated blocks are
>> copied across a cluster?  Either limiting the bandwidth or the number of
>> blocks per time period would work.
>>
>> I'm currently running Hadoop v1.0.1.  I think the
>> dfs.namenode.replication.work.multiplier.per.iteration option would do the
>> trick, but that is in v1.1.0 and higher.
>>
>> Thanks.
>>
>> --Brennon



Re: Throttle replication speed in case of datanode failure

Posted by Jean-Daniel Cryans <jd...@apache.org>.
Since this is a Hadoop question, it should be sent
user@hadoop.apache.org (which I'm now sending this to and I put
user@hbase in BCC).

J-D

On Thu, Jan 17, 2013 at 9:54 AM, Brennon Church <br...@getjar.com> wrote:
> Hello,
>
> Is there a way to throttle the speed at which under-replicated blocks are
> copied across a cluster?  Either limiting the bandwidth or the number of
> blocks per time period would work.
>
> I'm currently running Hadoop v1.0.1.  I think the
> dfs.namenode.replication.work.multiplier.per.iteration option would do the
> trick, but that is in v1.1.0 and higher.
>
> Thanks.
>
> --Brennon

Re: Throttle replication speed in case of datanode failure

Posted by Jean-Daniel Cryans <jd...@apache.org>.
Since this is a Hadoop question, it should be sent
user@hadoop.apache.org (which I'm now sending this to and I put
user@hbase in BCC).

J-D

On Thu, Jan 17, 2013 at 9:54 AM, Brennon Church <br...@getjar.com> wrote:
> Hello,
>
> Is there a way to throttle the speed at which under-replicated blocks are
> copied across a cluster?  Either limiting the bandwidth or the number of
> blocks per time period would work.
>
> I'm currently running Hadoop v1.0.1.  I think the
> dfs.namenode.replication.work.multiplier.per.iteration option would do the
> trick, but that is in v1.1.0 and higher.
>
> Thanks.
>
> --Brennon

Re: Throttle replication speed in case of datanode failure

Posted by Jean-Daniel Cryans <jd...@apache.org>.
Since this is a Hadoop question, it should be sent
user@hadoop.apache.org (which I'm now sending this to and I put
user@hbase in BCC).

J-D

On Thu, Jan 17, 2013 at 9:54 AM, Brennon Church <br...@getjar.com> wrote:
> Hello,
>
> Is there a way to throttle the speed at which under-replicated blocks are
> copied across a cluster?  Either limiting the bandwidth or the number of
> blocks per time period would work.
>
> I'm currently running Hadoop v1.0.1.  I think the
> dfs.namenode.replication.work.multiplier.per.iteration option would do the
> trick, but that is in v1.1.0 and higher.
>
> Thanks.
>
> --Brennon

Re: Throttle replication speed in case of datanode failure

Posted by Jean-Daniel Cryans <jd...@apache.org>.
Since this is a Hadoop question, it should be sent
user@hadoop.apache.org (which I'm now sending this to and I put
user@hbase in BCC).

J-D

On Thu, Jan 17, 2013 at 9:54 AM, Brennon Church <br...@getjar.com> wrote:
> Hello,
>
> Is there a way to throttle the speed at which under-replicated blocks are
> copied across a cluster?  Either limiting the bandwidth or the number of
> blocks per time period would work.
>
> I'm currently running Hadoop v1.0.1.  I think the
> dfs.namenode.replication.work.multiplier.per.iteration option would do the
> trick, but that is in v1.1.0 and higher.
>
> Thanks.
>
> --Brennon

Re: Throttle replication speed in case of datanode failure

Posted by Jean-Daniel Cryans <jd...@apache.org>.
Since this is a Hadoop question, it should be sent
user@hadoop.apache.org (which I'm now sending this to and I put
user@hbase in BCC).

J-D

On Thu, Jan 17, 2013 at 9:54 AM, Brennon Church <br...@getjar.com> wrote:
> Hello,
>
> Is there a way to throttle the speed at which under-replicated blocks are
> copied across a cluster?  Either limiting the bandwidth or the number of
> blocks per time period would work.
>
> I'm currently running Hadoop v1.0.1.  I think the
> dfs.namenode.replication.work.multiplier.per.iteration option would do the
> trick, but that is in v1.1.0 and higher.
>
> Thanks.
>
> --Brennon