How to copy over using dfs

[Mohit Anchlia <mo...@gmail.com>]

If I have to overwrite a file I generally use

hadoop dfs -rm <file>
hadoop dfs -copyFromLocal or -put <file>

Is there a command to overwrite/replace the file instead of doing rm first?

Re: How to copy over using dfs

[Mark question <ma...@gmail.com>]

I don't think so, becauseI read somewhere that this is to insure the safety
of the produced data. Hence Hadoop will force you to do this to know what
exactly is happening.

Mark

On Fri, May 27, 2011 at 12:28 PM, Mohit Anchlia <mo...@gmail.com>wrote:

> If I have to overwrite a file I generally use
>
> hadoop dfs -rm <file>
> hadoop dfs -copyFromLocal or -put <file>
>
> Is there a command to overwrite/replace the file instead of doing rm first?
>

Re: How to copy over using dfs

[Harsh J <ha...@cloudera.com>]

Mohit,

On Sat, May 28, 2011 at 12:58 AM, Mohit Anchlia <mo...@gmail.com> wrote:
> If I have to overwrite a file I generally use
>
> hadoop dfs -rm <file>
> hadoop dfs -copyFromLocal or -put <file>
>
> Is there a command to overwrite/replace the file instead of doing rm first?
>

There's no command available right now to do this (best to write a
wrapper script acting as a command, or a custom shell utility
program?)

That said, https://issues.apache.org/jira/browse/HDFS-1608 covers the
addition of -f/-overwrite feature and it may be available in future
releases (possibly 0.23+).

-- 
Harsh J