You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by nalgonda <de...@gmail.com> on 2008/08/28 11:06:59 UTC

How to crawl any sites using nutch without cygwin

Hi,
How to crawl any sites using nutch without cygwin
simply in cygwin we give in command prompt  bin/nutch crawl urls -dir crawl
-depth 2 -topN 1
instaed of this any scenario developing java api using nutch
-- 
View this message in context: http://www.nabble.com/How-to-crawl-any-sites-using-nutch-without-cygwin-tp19196869p19196869.html
Sent from the Nutch - User mailing list archive at Nabble.com.


Re: How to crawl any sites using nutch without cygwin

Posted by nalgonda <de...@gmail.com>.
Hi,
Thanks for u r reply
is there any posible for integarting nutch with struts
if posible please let me know?

Thanks,




nalgonda wrote:
> 
> Hi,
> How to crawl any sites using nutch without cygwin
> simply in cygwin we give in command prompt  bin/nutch crawl urls -dir
> crawl -depth 2 -topN 1
> instaed of this any scenario developing java api using nutch
> 

-- 
View this message in context: http://www.nabble.com/How-to-crawl-any-sites-using-nutch-without-cygwin-tp19196869p19199727.html
Sent from the Nutch - User mailing list archive at Nabble.com.


Re: How to crawl any sites using nutch without cygwin

Posted by nalgonda <de...@gmail.com>.
hi,
how to integate nutch with struts in eclipse

Thanks,



Andrzej Bialecki wrote:
> 
> Thorsten Scherler wrote:
>> On Thu, 2008-08-28 at 02:06 -0700, nalgonda wrote:
>>> Hi,
>>> How to crawl any sites using nutch without cygwin
>>> simply in cygwin we give in command prompt  bin/nutch crawl urls -dir
>>> crawl
>>> -depth 2 -topN 1
>>> instaed of this any scenario developing java api using nutch
>> 
>> ¿?
>> 
>> If you take the time to see the bin/nutch then you find as last line
>> exec "$JAVA" $JAVA_HEAP_MAX $NUTCH_OPTS -classpath "$CLASSPATH" $CLASS
>> "$@"
> 
> At the moment running Nutch without Cygwin does NOT work, even if you 
> call Nutch classes directly from other applications. The reason is that 
> the underlying framework (Hadoop) needs to call /bin/whoami and /bin/df.
> 
> 
> -- 
> Best regards,
> Andrzej Bialecki     <><
>   ___. ___ ___ ___ _ _   __________________________________
> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> http://www.sigram.com  Contact: info at sigram dot com
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/How-to-crawl-any-sites-using-nutch-without-cygwin-tp19196869p19214188.html
Sent from the Nutch - User mailing list archive at Nabble.com.


Re: How to crawl any sites using nutch without cygwin

Posted by Andrzej Bialecki <ab...@getopt.org>.
Thorsten Scherler wrote:
> On Thu, 2008-08-28 at 02:06 -0700, nalgonda wrote:
>> Hi,
>> How to crawl any sites using nutch without cygwin
>> simply in cygwin we give in command prompt  bin/nutch crawl urls -dir crawl
>> -depth 2 -topN 1
>> instaed of this any scenario developing java api using nutch
> 
> ¿?
> 
> If you take the time to see the bin/nutch then you find as last line
> exec "$JAVA" $JAVA_HEAP_MAX $NUTCH_OPTS -classpath "$CLASSPATH" $CLASS
> "$@"

At the moment running Nutch without Cygwin does NOT work, even if you 
call Nutch classes directly from other applications. The reason is that 
the underlying framework (Hadoop) needs to call /bin/whoami and /bin/df.


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Re: How to crawl any sites using nutch without cygwin

Posted by Thorsten Scherler <th...@juntadeandalucia.es>.
On Thu, 2008-08-28 at 02:06 -0700, nalgonda wrote:
> Hi,
> How to crawl any sites using nutch without cygwin
> simply in cygwin we give in command prompt  bin/nutch crawl urls -dir crawl
> -depth 2 -topN 1
> instaed of this any scenario developing java api using nutch

¿?

If you take the time to see the bin/nutch then you find as last line
exec "$JAVA" $JAVA_HEAP_MAX $NUTCH_OPTS -classpath "$CLASSPATH" $CLASS
"$@"

salu2
-- 
Thorsten Scherler                                 thorsten.at.apache.org
Open Source Java                      consulting, training and solutions


Re: How to crawl any sites using nutch without cygwin

Posted by Alexander Aristov <al...@gmail.com>.
Instead run it on a linux machine :)

On 28/08/2008, nalgonda <de...@gmail.com> wrote:
>
>
> Hi,
> How to crawl any sites using nutch without cygwin
> simply in cygwin we give in command prompt  bin/nutch crawl urls -dir crawl
> -depth 2 -topN 1
> instaed of this any scenario developing java api using nutch
> --
> View this message in context:
> http://www.nabble.com/How-to-crawl-any-sites-using-nutch-without-cygwin-tp19196869p19196869.html
> Sent from the Nutch - User mailing list archive at Nabble.com.
>
>


-- 
Best Regards
Alexander Aristov