You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Gareth Gale <ga...@hp.com> on 2010/04/07 13:32:07 UTC
Curious error happening - "No input paths specified in input" - HELP
!
Running nutch 0.9 for a long time without problems, but have just
started to see this error when executing (all from within the nutch 0.9
bin directory) :-
./nutch mergesegs $crawldir/MERGEDsegments $crawldir/segements/*
The error is :-
Exception in thread "main" java.io.IOException: No input paths specified
in input
at
org.apache.hadoop.mapred.InputFormatBase.validateInput(InputFormatBase.java:99)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:326)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:543)
at
org.apache.nutch.segment.SegmentMerger.merge(SegmentMerger.java:590)
at
org.apache.nutch.segment.SegmentMerger.main(SegmentMerger.java:638)
I've tried both a 1.5 and 1.6 java vm but get the same result.
I have no idea how this is happening or why, but need to fix it asap -
any help much appreciated !
Re: crawling without topN
Posted by whereIstand help <he...@whereistand.com>.
Please take me off this list.
On Wed, Apr 7, 2010 at 8:20 AM, Patricio Galeas <pg...@yahoo.de> wrote:
> Hi all,
>
> I ran a web-crawl using a domain filter for a specific country.
> -----------regex-urlfilter.txt--------------
> # URLs ending with the domain .al
> +^http://(.*(\.al|\.al/.*)$)
>
> # skip anything else
> -.
> ----------------------------------------------
>
> Even though I didn't set the topN parameter, all new generated segments
> have almost the same size.
> Is it a normal behavior?
>
> Thanks
> Pato
>
> __________________________________________________
> Do You Yahoo!?
> Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz
> gegen Massenmails.
> http://mail.yahoo.com
>
crawling without topN
Posted by Patricio Galeas <pg...@yahoo.de>.
Hi all,
I ran a web-crawl using a domain filter for a specific country.
-----------regex-urlfilter.txt--------------
# URLs ending with the domain .al
+^http://(.*(\.al|\.al/.*)$)
# skip anything else
-.
----------------------------------------------
Even though I didn't set the topN parameter, all new generated segments have almost the same size.
Is it a normal behavior?
Thanks
Pato
__________________________________________________
Do You Yahoo!?
Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz gegen Massenmails.
http://mail.yahoo.com
Re: Curious error happening - "No input paths specified in input" -
HELP !
Posted by cefurkan0 cefurkan0 <ce...@gmail.com>.
hi. what does this command supposed to do ?
also do you know is there any way i can parse and save text of html files
while crawling ?
On 7 April 2010 14:32, Gareth Gale <ga...@hp.com> wrote:
> Running nutch 0.9 for a long time without problems, but have just started
> to see this error when executing (all from within the nutch 0.9 bin
> directory) :-
>
> ./nutch mergesegs $crawldir/MERGEDsegments $crawldir/segements/*
>
> The error is :-
>
> Exception in thread "main" java.io.IOException: No input paths specified in
> input
> at
> org.apache.hadoop.mapred.InputFormatBase.validateInput(InputFormatBase.java:99)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:326)
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:543)
> at
> org.apache.nutch.segment.SegmentMerger.merge(SegmentMerger.java:590)
> at
> org.apache.nutch.segment.SegmentMerger.main(SegmentMerger.java:638)
>
>
> I've tried both a 1.5 and 1.6 java vm but get the same result.
>
> I have no idea how this is happening or why, but need to fix it asap - any
> help much appreciated !
>