You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by John X <jo...@neasys.com> on 2006/01/21 01:55:17 UTC
tool to mount nutch filesystem
I have created a simple tool to mount nutch filesystem on linux.
http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
Check README inside for how to set up.
It is very barebone, only browse, no read/write yet.
Doug and Mike: any plan to make ndfs codes into a separate package?
Best,
John
__________________________________________
http://www.neasys.com - A Good Place to Be
Come to visit us today!
Re: tool to mount nutch filesystem
Posted by John X <jo...@neasys.com>.
Hi, Mike,
On Tue, Feb 07, 2006 at 10:18:11AM -0800, Michael Cafarella wrote:
>
> John,
>
> This is a pretty awesome idea. Do you have any performance
> numbers or experience with it you can share?
No number yet. Just created it for my immediate use of browsing
and moving around files. It uses DFSClient.java to do real work.
My impression is that it's similar to DFSShell.java.
I might have time late this week for generating some numbers
on my testbed (only 4 nodes though). Any specifics that you are interested in?
John
>
> --Mike
>
> On Thu, 2006-02-02 at 23:19, John X wrote:
> > On Sat, Jan 21, 2006 at 09:23:01AM -0800, John X wrote:
> > > Hi, Sami,
> > >
> > > On Sat, Jan 21, 2006 at 05:32:37PM +0200, Sami Siren wrote:
> > > > >I have created a simple tool to mount nutch filesystem on linux.
> > > > >http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
> > > > >Check README inside for how to set up.
> > > > >It is very barebone, only browse, no read/write yet.
> > > > >
> > > > >Doug and Mike: any plan to make ndfs codes into a separate package?
> > > >
> > > > John,
> > > >
> > > > I didn't check out your version yet, but I have also written
> > > > a version wich is read/write capable, should we combine our efforts here?
> > >
> > > Sure, why not ;-) Let me know where your stuff is.
> >
> > The tarball, now called fuse-hadoop-0.1.0.tar.gz, is attached at
> > https://issues.apache.org/jira/browse/NUTCH-199.
> > A result of combined work of Sami's and mine. It does read/write.
> >
> > John
>
>
>
__________________________________________
http://www.neasys.com - A Good Place to Be
Come to visit us today!
Re: tool to mount nutch filesystem
Posted by Michael Cafarella <mi...@comcast.net>.
John,
This is a pretty awesome idea. Do you have any performance
numbers or experience with it you can share?
--Mike
On Thu, 2006-02-02 at 23:19, John X wrote:
> On Sat, Jan 21, 2006 at 09:23:01AM -0800, John X wrote:
> > Hi, Sami,
> >
> > On Sat, Jan 21, 2006 at 05:32:37PM +0200, Sami Siren wrote:
> > > >I have created a simple tool to mount nutch filesystem on linux.
> > > >http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
> > > >Check README inside for how to set up.
> > > >It is very barebone, only browse, no read/write yet.
> > > >
> > > >Doug and Mike: any plan to make ndfs codes into a separate package?
> > >
> > > John,
> > >
> > > I didn't check out your version yet, but I have also written
> > > a version wich is read/write capable, should we combine our efforts here?
> >
> > Sure, why not ;-) Let me know where your stuff is.
>
> The tarball, now called fuse-hadoop-0.1.0.tar.gz, is attached at
> https://issues.apache.org/jira/browse/NUTCH-199.
> A result of combined work of Sami's and mine. It does read/write.
>
> John
Re: tool to mount nutch filesystem
Posted by John X <jo...@neasys.com>.
On Sat, Jan 21, 2006 at 09:23:01AM -0800, John X wrote:
> Hi, Sami,
>
> On Sat, Jan 21, 2006 at 05:32:37PM +0200, Sami Siren wrote:
> > >I have created a simple tool to mount nutch filesystem on linux.
> > >http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
> > >Check README inside for how to set up.
> > >It is very barebone, only browse, no read/write yet.
> > >
> > >Doug and Mike: any plan to make ndfs codes into a separate package?
> >
> > John,
> >
> > I didn't check out your version yet, but I have also written
> > a version wich is read/write capable, should we combine our efforts here?
>
> Sure, why not ;-) Let me know where your stuff is.
The tarball, now called fuse-hadoop-0.1.0.tar.gz, is attached at
https://issues.apache.org/jira/browse/NUTCH-199.
A result of combined work of Sami's and mine. It does read/write.
John
Re: tool to mount nutch filesystem
Posted by John X <jo...@neasys.com>.
Hi, Sami,
On Sat, Jan 21, 2006 at 05:32:37PM +0200, Sami Siren wrote:
> >I have created a simple tool to mount nutch filesystem on linux.
> >http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
> >Check README inside for how to set up.
> >It is very barebone, only browse, no read/write yet.
> >
> >Doug and Mike: any plan to make ndfs codes into a separate package?
>
> John,
>
> I didn't check out your version yet, but I have also written
> a version wich is read/write capable, should we combine our efforts here?
Sure, why not ;-) Let me know where your stuff is.
John
>
> --
> Sami Siren
>
__________________________________________
http://www.neasys.com - A Good Place to Be
Come to visit us today!
Re: tool to mount nutch filesystem
Posted by Sami Siren <s....@sonera.inet.fi>.
> I have created a simple tool to mount nutch filesystem on linux.
> http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
> Check README inside for how to set up.
> It is very barebone, only browse, no read/write yet.
>
> Doug and Mike: any plan to make ndfs codes into a separate package?
John,
I didn't check out your version yet, but I have also written
a version wich is read/write capable, should we combine our efforts here?
--
Sami Siren
Re: tool to mount nutch filesystem
Posted by Andrzej Bialecki <ab...@getopt.org>.
John X wrote:
> Hi, Otis,
>
> On Fri, Jan 20, 2006 at 09:31:16PM -0800, ogjunk-nutch@yahoo.com wrote:
>
>> Hi John,
>>
>> NDFS + MapReduce will soon become a separate Lucene sub-project.
>>
>
> In one sub-project or two separately?
>
In one. They are closely related anyway.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
Re: tool to mount nutch filesystem
Posted by John X <jo...@neasys.com>.
Hi, Otis,
On Fri, Jan 20, 2006 at 09:31:16PM -0800, ogjunk-nutch@yahoo.com wrote:
> Hi John,
>
> NDFS + MapReduce will soon become a separate Lucene sub-project.
In one sub-project or two separately?
Thanks,
John
>
> Otis
>
> ----- Original Message ----
> From: John X <jo...@neasys.com>
> To: nutch-dev@lucene.apache.org
> Cc: john@neasys.com
> Sent: Fri 20 Jan 2006 07:55:17 PM EST
> Subject: tool to mount nutch filesystem
>
> I have created a simple tool to mount nutch filesystem on linux.
> http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
> Check README inside for how to set up.
> It is very barebone, only browse, no read/write yet.
>
> Doug and Mike: any plan to make ndfs codes into a separate package?
>
> Best,
>
> John
>
> __________________________________________
> http://www.neasys.com - A Good Place to Be
> Come to visit us today!
>
>
>
>
__________________________________________
http://www.neasys.com - A Good Place to Be
Come to visit us today!
Re: tool to mount nutch filesystem
Posted by og...@yahoo.com.
Hi John,
NDFS + MapReduce will soon become a separate Lucene sub-project.
Otis
----- Original Message ----
From: John X <jo...@neasys.com>
To: nutch-dev@lucene.apache.org
Cc: john@neasys.com
Sent: Fri 20 Jan 2006 07:55:17 PM EST
Subject: tool to mount nutch filesystem
I have created a simple tool to mount nutch filesystem on linux.
http://nutch.neasys.com/ndfs/fuse-nutchfs-0.1.0.tar.gz
Check README inside for how to set up.
It is very barebone, only browse, no read/write yet.
Doug and Mike: any plan to make ndfs codes into a separate package?
Best,
John
__________________________________________
http://www.neasys.com - A Good Place to Be
Come to visit us today!