You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Mark Wildig <ma...@ovationdata.com> on 2014/07/26 12:13:24 UTC

Database view of the file system

Morning all, 
We are needing to give our users a database view of the file system, this needs to be live so as a file is added to a HDFS file system it's immediately visible In the database.
Any advice on how to achieve this  or even if it's possible using Hadoop and Hive would be very much appreciated
Thanks in advance 

Mark Wildig

   
Sent from my iPhone

Re: Database view of the file system

Posted by Ted Xu <fr...@gmail.com>.

Hi Mark,

I'm not sure if there is more elegant solution, but if you have full
control of the HDFS namenode, you can try parse Hadoop Audit Logs.

You can find more information here:
http://wiki.apache.org/hadoop/HowToConfigure


2014-07-26 18:13 GMT+08:00 Mark Wildig <ma...@ovationdata.com>:

> Morning all,
> We are needing to give our users a database view of the file system, this
> needs to be live so as a file is added to a HDFS file system it's
> immediately visible In the database.
> Any advice on how to achieve this  or even if it's possible using Hadoop
> and Hive would be very much appreciated
> Thanks in advance
>
> Mark Wildig
>
>
> Sent from my iPhone




-- 
Ted Xu
Alibaba Inc.
Hangzhou, China