You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by 李立伟 <hi...@gmail.com> on 2018/02/02 11:26:36 UTC

HDFS replication factor

Hi:
      It's my understanding that HDFS write  operation is not considered
completd until all of the replicas have been successfully written.If so,
does the replication factor affect the write latency? the mapreduce\spark
task will be affected?
      is there the way to set HDFS write the first replica synchronously
and return ,the others in an asynchronous.
      Thanks in advance.

Fwd: HDFS replication factor

Posted by 李立伟 <hi...@gmail.com>.

Hi:
      It's my understanding that HDFS write  operation is not considered
completd until all of the replicas have been successfully written.If so,
does the replication factor affect the write latency? the mapreduce\spark
task will be affected?
      is there the way to set HDFS write the first replica synchronously
and return ,the others in an asynchronous.
      Thanks in advance.

Re: HDFS replication factor

Posted by "☼ R Nair (रविशंकर नायर)" <ra...@gmail.com>.

This is solved in Hadoop 3. So stay tuned

Best,

On Feb 2, 2018 6:26 AM, "李立伟" <hi...@gmail.com> wrote:

> Hi:
>       It's my understanding that HDFS write  operation is not considered
> completd until all of the replicas have been successfully written.If so,
> does the replication factor affect the write latency? the mapreduce\spark
> task will be affected?
>       is there the way to set HDFS write the first replica synchronously
> and return ,the others in an asynchronous.
>       Thanks in advance.
>
>
>