HDFS concurrent access

[Gokulakannan M <go...@huawei.com>]

 I want to know whether an API exists for the following functionality.?

 

 One user(user1) is writing to a large file(size 100MB) and another
user(user2) wants to read that file once user1 completes the writing. So is
there an API exists for this functionality of waiting?

 

  Thanks,

  Gokul

 

  

 

RE: HDFS concurrent access

[Gokulakannan M <go...@huawei.com>]

 

Thanks Todd. I will try it out. 

 

  _____  

From: Todd Lipcon [mailto:todd@cloudera.com] 
Sent: Wednesday, January 13, 2010 1:00 PM
To: hdfs-user@hadoop.apache.org; gokulm@huawei.com
Subject: Re: HDFS concurrent access

 

Hi Gokul,

That function doesn't exist as of yet. Your best bet is to poll for the
file's existence or use an external mechanism like ZooKeeper to communicate
and coordinate between clients.

Thanks
-Todd

On Tue, Jan 12, 2010 at 10:14 PM, Gokulakannan M <go...@huawei.com> wrote:

 I want to know whether an API exists for the following functionality.?

 

 One user(user1) is writing to a large file(size 100MB) and another
user(user2) wants to read that file once user1 completes the writing. So is
there an API exists for this functionality of waiting?

 

  Thanks,

  Gokul

 

  

 

 

Re: HDFS concurrent access

[Todd Lipcon <to...@cloudera.com>]

Hi Gokul,

That function doesn't exist as of yet. Your best bet is to poll for the
file's existence or use an external mechanism like ZooKeeper to communicate
and coordinate between clients.

Thanks
-Todd

On Tue, Jan 12, 2010 at 10:14 PM, Gokulakannan M <go...@huawei.com> wrote:

>   I want to know whether an API exists for the following functionality.?
>
>
>
>  One user(user1) is writing to a large file(size 100MB) and another
> user(user2) wants to read that file once user1 completes the writing. So is
> there an API exists for this functionality of waiting?
>
>
>
>   Thanks,
>
>   Gokul
>
>
>
>
>
>
>