DirTailing an HDFS directory

[Oded Rosen <od...@legolas-media.com>]

Hi,
I do believe I remember reading about this somewhere, but I could not find
it anywhere now:

Can the FileTailingAdapter (or the DirTailAdapter, for that matter) tail
files that lie inside hdfs?
How do you configure an adapter to do that? just supply the hdfs:///
notation as the file (or dir) name?

Thanks
-- 
Oded

Re: DirTailing an HDFS directory

[Ariel Rabkin <as...@gmail.com>]

There isn't currently a way to do that.  I don't quite understand what
the use case is.  Why is distcp not the right thing to do in that
case?

--Ari

On Fri, Apr 16, 2010 at 1:10 AM, Oded Rosen <od...@legolas-media.com> wrote:
> Hi,
> I do believe I remember reading about this somewhere, but I could not find
> it anywhere now:
>
> Can the FileTailingAdapter (or the DirTailAdapter, for that matter) tail
> files that lie inside hdfs?
> How do you configure an adapter to do that? just supply the hdfs:///
> notation as the file (or dir) name?
>
> Thanks
> --
> Oded
>



-- 
Ari Rabkin asrabkin@gmail.com
UC Berkeley Computer Science Department