You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Markus Jelsma <ma...@openindex.io> on 2011/10/25 01:47:02 UTC

Difference in #records and #lines in CrawlDB

Hi,

One of our CrawlDB's counts 165.401.284 records and wc counts 165.439.016 
lines in a CSV export. A difference of 37.732. I suspect there may be records 
in the CSV export with a \n in the URL. Is this possible at all?

Thanks,
Markus