You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "nutch.buddy@gmail.com" <nu...@gmail.com> on 2012/06/25 08:03:02 UTC
a basic test crawl takes much more time in nutch 1.5 than 1.4
I'm running nutch 1.4 and 1.5 on same list of urls (2 urls).
I use same configuration and I run in local mode.
First of all, for some reason, nutch 1.5 can't find jars that are not in its
/lib folder (I have to put there jars that are used by the parsers in order
for them to work..). Though I see in nutch script that the the whole nutch
folder is added to the classpath. In in case, the script in nutch 1.4 is the
same and there's no problem with the classpath there.
But what is really odd is the difference in running time.
nutch 1.4:
total: 19 seconds.
injecting time: 2 seconds
generator time: 3 seconds
nutch 1.5:
total: 74 seconds.
injecting time: 14 seconds.
generator time: 15 seconds
any known issue with this?
Thanks.
--
View this message in context: http://lucene.472066.n3.nabble.com/a-basic-test-crawl-takes-much-more-time-in-nutch-1-5-than-1-4-tp3991130.html
Sent from the Nutch - User mailing list archive at Nabble.com.