You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon" <ed...@apache.org> on 2012/10/16 10:52:12 UTC
Replication of checkpoint data
If I set the dfs.replication factor to 3 then, each checkpoints will
also have 3 replications. Am I right?
>> checkpointStream = this.fs.create(new Path(checkpointedPath));
Should it be configurable?
--
Best Regards, Edward J. Yoon
@eddieyoon
Re: Replication of checkpoint data
Posted by "Edward J. Yoon" <ed...@apache.org>.
I see!
On Tue, Oct 16, 2012 at 6:03 PM, Suraj Menon <me...@gmail.com> wrote:
> Yes. But I thought this could be configurable on just HDFS deployment. If
> we checkpoint on local disk, we will loose the checkpointed files. That is
> why I was looking at sender side checkpointing on local disk and replay on
> error. Sorry, I have been too busy at work for past week or two.
>
> On Tue, Oct 16, 2012 at 4:52 AM, Edward J. Yoon <ed...@apache.org>wrote:
>
>> If I set the dfs.replication factor to 3 then, each checkpoints will
>> also have 3 replications. Am I right?
>>
>> >> checkpointStream = this.fs.create(new Path(checkpointedPath));
>>
>> Should it be configurable?
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
--
Best Regards, Edward J. Yoon
@eddieyoon
Re: Replication of checkpoint data
Posted by Suraj Menon <me...@gmail.com>.
Yes. But I thought this could be configurable on just HDFS deployment. If
we checkpoint on local disk, we will loose the checkpointed files. That is
why I was looking at sender side checkpointing on local disk and replay on
error. Sorry, I have been too busy at work for past week or two.
On Tue, Oct 16, 2012 at 4:52 AM, Edward J. Yoon <ed...@apache.org>wrote:
> If I set the dfs.replication factor to 3 then, each checkpoints will
> also have 3 replications. Am I right?
>
> >> checkpointStream = this.fs.create(new Path(checkpointedPath));
>
> Should it be configurable?
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>