You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "Kursun, Mahmut" <Ma...@com-magazin.de> on 2006/09/25 16:03:45 UTC
Which Operating-System do you use for Nutch
Hi,
I want to install Nutch for testing purposes and would like to know
which OS, Filesystem and sort of Harddiscs other Nutch users prefer.
What I am going to use is Fedora Core 6 Test 3 with ext3 on a 40-80 GB
IDE Harddisc. That is also to test Fedora Core 6 Test 3. But I am free
to install any OS or Filesystem that I like.
Viele Grüße
Mahmut Kursun
Redaktion com! - Das Computer-Magazin
Neue Mediengesellschaft mbH
Bayerstr. 26
80335 München
Telefon: +49 / 89 / 74 117-641
Telefax: +49 / 89 / 74 117-132
mahmut.kursun@com-magazin.de
http://www.com-magazin.de
Re: Which Operating-System do you use for Nutch
Posted by Dima Mazmanov <nu...@proservice.ge>.
Hi,Mahmut.
I prefer FreeBSD 5.4, 6.0.
I have nutch installed on 3 machines, built into one cluster.
So, filesystem is UFS, hardisks are different.
You wrote 25 ñåíòÿáðÿ 2006 ã., 18:03:45:
> Hi,
> I want to install Nutch for testing purposes and would like to know
> which OS, Filesystem and sort of Harddiscs other Nutch users prefer.
> What I am going to use is Fedora Core 6 Test 3 with ext3 on a 40-80 GB
> IDE Harddisc. That is also to test Fedora Core 6 Test 3. But I am free
> to install any OS or Filesystem that I like.
> Viele Grüße
> Mahmut Kursun
> Redaktion com! - Das Computer-Magazin
> Neue Mediengesellschaft mbH
> Bayerstr. 26
> 80335 München
> Telefon: +49 / 89 / 74 117-641
> Telefax: +49 / 89 / 74 117-132
> mahmut.kursun@com-magazin.de
> http://www.com-magazin.de
> __________ NOD32 1.1773 (20060925) Information __________
> This message was checked by NOD32 antivirus system.
> http://www.eset.com
--
Regards,
Dima mailto:nuther@proservice.ge
Re: Which Operating-System do you use for Nutch
Posted by Dennis Kubes <nu...@dragonflymc.com>.
Fedora Core 5 minimal install with Java 1.5.10
Tomi NA wrote:
> On 9/26/06, Jim Wilson <wi...@gmail.com> wrote:
>> I'd do it, but I'm too busy being consumed with worries about the
>> lack of
>> support for HTTP/NTLM credentials and SMB fileshare indexing.
>>
>> Arrrgg - tis another sad day in the life of this pirate.
>
> We seem to share the same problems...they haven't gone and knocked me
> down...yet, but I expect they might fairly soon.
> For now, I'm placing the shares under an IIS umbrella: I direct the
> crawl to the root of the web and serve http links to the files. IIS
> (somehow) takes care of A/D authorization: once the user clicks on a
> link, IIS checks the users credentials and matches it to the files ACL
> (I suppose). The downsides? Even though I could theoretically allow
> the users with sufficient privileges to write files, I can only
> provide WebDAV access. Whats more, I'm stuck with
> IIS/Windows/whatever. I'd much rather let the customer decide what he
> wants to run on his servers. Finally, distributed network shares (i.e.
> shares not shared from the server) make the problem/solution
> significantly more complicated.
> Alternatively, you could try with the file protocol, generating
> "browser unfriendly" file:// links, opens up it's own Pandora's box of
> security issues...so, how do you go about it?
>
> t.n.a.
Re: Which Operating-System do you use for Nutch
Posted by Tomi NA <he...@gmail.com>.
On 9/26/06, Jim Wilson <wi...@gmail.com> wrote:
> I'd do it, but I'm too busy being consumed with worries about the lack of
> support for HTTP/NTLM credentials and SMB fileshare indexing.
>
> Arrrgg - tis another sad day in the life of this pirate.
We seem to share the same problems...they haven't gone and knocked me
down...yet, but I expect they might fairly soon.
For now, I'm placing the shares under an IIS umbrella: I direct the
crawl to the root of the web and serve http links to the files. IIS
(somehow) takes care of A/D authorization: once the user clicks on a
link, IIS checks the users credentials and matches it to the files ACL
(I suppose). The downsides? Even though I could theoretically allow
the users with sufficient privileges to write files, I can only
provide WebDAV access. Whats more, I'm stuck with
IIS/Windows/whatever. I'd much rather let the customer decide what he
wants to run on his servers. Finally, distributed network shares (i.e.
shares not shared from the server) make the problem/solution
significantly more complicated.
Alternatively, you could try with the file protocol, generating
"browser unfriendly" file:// links, opens up it's own Pandora's box of
security issues...so, how do you go about it?
t.n.a.
Re: Which Operating-System do you use for Nutch
Posted by Jim Wilson <wi...@gmail.com>.
I'd do it, but I'm too busy being consumed with worries about the lack of
support for HTTP/NTLM credentials and SMB fileshare indexing.
Arrrgg - tis another sad day in the life of this pirate.
-- Jim
On 9/26/06, Tomi NA <he...@gmail.com> wrote:
>
> On 9/25/06, Jim Wilson <wi...@gmail.com> wrote:
> > <flamebait>
> > You can get it working on Windows if you're willing to work for it. To
> use
> > Nutch OOTB, you have to install Cygwin since the provided Nutch launcher
> is
> > written in Bash.
> >
> > Members of the community have provided alternatives, such as this Python
> > lanucher: http://wiki.apache.org/nutch/CrossPlatformNutchScripts
> > </flamebait>
>
> The way I see it, the existing shell scripts are not a permanent
> solution. That said, python is better than (ba)sh, but java would be
> even better (even though fs operations are not one liners). My (very
> superfluous, but still) experiences with bean shell suggest that it
> might be a good long term, platform independent solution.
> It will probably happen when someone scratches that particular itch,
> though, meaning it's author is going to be someone developing on
> windows. :)
>
> t.n.a.
>
Re: Which Operating-System do you use for Nutch
Posted by Tomi NA <he...@gmail.com>.
On 9/25/06, Jim Wilson <wi...@gmail.com> wrote:
> <flamebait>
> You can get it working on Windows if you're willing to work for it. To use
> Nutch OOTB, you have to install Cygwin since the provided Nutch launcher is
> written in Bash.
>
> Members of the community have provided alternatives, such as this Python
> lanucher: http://wiki.apache.org/nutch/CrossPlatformNutchScripts
> </flamebait>
The way I see it, the existing shell scripts are not a permanent
solution. That said, python is better than (ba)sh, but java would be
even better (even though fs operations are not one liners). My (very
superfluous, but still) experiences with bean shell suggest that it
might be a good long term, platform independent solution.
It will probably happen when someone scratches that particular itch,
though, meaning it's author is going to be someone developing on
windows. :)
t.n.a.
Re: Which Operating-System do you use for Nutch
Posted by Jim Wilson <wi...@gmail.com>.
<flamebait>
You can get it working on Windows if you're willing to work for it. To use
Nutch OOTB, you have to install Cygwin since the provided Nutch launcher is
written in Bash.
Members of the community have provided alternatives, such as this Python
lanucher: http://wiki.apache.org/nutch/CrossPlatformNutchScripts
</flamebait>
On 9/25/06, Brian Cuttler <br...@wadsworth.org> wrote:
>
> On Mon, Sep 25, 2006 at 04:03:45PM +0200, Kursun, Mahmut wrote:
> > Hi,
> >
> > I want to install Nutch for testing purposes and would like to know
> > which OS, Filesystem and sort of Harddiscs other Nutch users prefer.
> >
> > What I am going to use is Fedora Core 6 Test 3 with ext3 on a 40-80 GB
> > IDE Harddisc. That is also to test Fedora Core 6 Test 3. But I am free
> > to install any OS or Filesystem that I like.
>
> Solaris with UFS file system, or did any mean any linux ? :-)
>
> >
> > Viele Grüße
> >
> > Mahmut Kursun
> > Redaktion com! - Das Computer-Magazin
> > Neue Mediengesellschaft mbH
> > Bayerstr. 26
> > 80335 München
> > Telefon: +49 / 89 / 74 117-641
> > Telefax: +49 / 89 / 74 117-132
> > mahmut.kursun@com-magazin.de
> > http://www.com-magazin.de
> ---
> Brian R Cuttler brian.cuttler@wadsworth.org
> Computer Systems Support (v) 518 486-1697
> Wadsworth Center (f) 518 473-6384
> NYS Department of Health Help Desk 518 473-0773
>
>
Re: Which Operating-System do you use for Nutch
Posted by Brian Cuttler <br...@wadsworth.org>.
On Mon, Sep 25, 2006 at 04:03:45PM +0200, Kursun, Mahmut wrote:
> Hi,
>
> I want to install Nutch for testing purposes and would like to know
> which OS, Filesystem and sort of Harddiscs other Nutch users prefer.
>
> What I am going to use is Fedora Core 6 Test 3 with ext3 on a 40-80 GB
> IDE Harddisc. That is also to test Fedora Core 6 Test 3. But I am free
> to install any OS or Filesystem that I like.
Solaris with UFS file system, or did any mean any linux ? :-)
>
> Viele Gr��e
>
> Mahmut Kursun
> Redaktion com! - Das Computer-Magazin
> Neue Mediengesellschaft mbH
> Bayerstr. 26
> 80335 M�nchen
> Telefon: +49 / 89 / 74 117-641
> Telefax: +49 / 89 / 74 117-132
> mahmut.kursun@com-magazin.de
> http://www.com-magazin.de
---
Brian R Cuttler brian.cuttler@wadsworth.org
Computer Systems Support (v) 518 486-1697
Wadsworth Center (f) 518 473-6384
NYS Department of Health Help Desk 518 473-0773
Re: Which Operating-System do you use for Nutch
Posted by Dima Mazmanov <nu...@proservice.ge>.
Hi,Mahmut.
It's up to you.
Nutch is written on Java, so it doesn't care about OS you have
installed ;)
Just install Java on ypur OS and have fun!;)
You wrote 25 ñåíòÿáðÿ 2006 ã., 18:03:45:
> Hi,
> I want to install Nutch for testing purposes and would like to know
> which OS, Filesystem and sort of Harddiscs other Nutch users prefer.
> What I am going to use is Fedora Core 6 Test 3 with ext3 on a 40-80 GB
> IDE Harddisc. That is also to test Fedora Core 6 Test 3. But I am free
> to install any OS or Filesystem that I like.
> Viele Grüße
> Mahmut Kursun
> Redaktion com! - Das Computer-Magazin
> Neue Mediengesellschaft mbH
> Bayerstr. 26
> 80335 München
> Telefon: +49 / 89 / 74 117-641
> Telefax: +49 / 89 / 74 117-132
> mahmut.kursun@com-magazin.de
> http://www.com-magazin.de
> __________ NOD32 1.1773 (20060925) Information __________
> This message was checked by NOD32 antivirus system.
> http://www.eset.com
--
Regards,
Dima mailto:nuther@proservice.ge
Re: Which Operating-System do you use for Nutch
Posted by Florian Fricker <fl...@wyona.com>.
Hi,
Works perfect with Mac OS X 10.4.7 as the operating system and HFS-Plus
as filesystem.
Regards
Kursun, Mahmut wrote:
> Hi,
>
> I want to install Nutch for testing purposes and would like to know
> which OS, Filesystem and sort of Harddiscs other Nutch users prefer.
>
> What I am going to use is Fedora Core 6 Test 3 with ext3 on a 40-80 GB
> IDE Harddisc. That is also to test Fedora Core 6 Test 3. But I am free
> to install any OS or Filesystem that I like.
>
> Viele Grüße
>
> Mahmut Kursun
> Redaktion com! - Das Computer-Magazin
> Neue Mediengesellschaft mbH
> Bayerstr. 26
> 80335 München
> Telefon: +49 / 89 / 74 117-641
> Telefax: +49 / 89 / 74 117-132
> mahmut.kursun@com-magazin.de
> http://www.com-magazin.de
>
>
>
--
Florian Fricker florian.fricker@wyona.com
Wyona Inc. - Open Source Content Management - Apache Lenya
http://www.wyona.com http://lenya.apache.org