You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by Farzad Valad <ho...@farzad.net> on 2011/06/03 22:11:24 UTC
Strange Exception
So I've been trying to figure this out for days now and still not even
close. So I'm getting this in the log file:
FATAL 2011-06-03 14:26:39,188 [Worker thread '22']
(WorkerThread.java:955) - Error tossed: null
java.lang.NullPointerException
at
org.apache.manifoldcf.agents.output.dupfinder.DupFinderConnector.addOrReplaceDocument(DupFinderConnector.java:153)
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.addOrReplaceDocument(IncrementalIngester.java:1433)
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.performIngestion(IncrementalIngester.java:418)
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:313)
at
org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocument(WorkerThread.java:1565)
at
org.apache.manifoldcf.crawler.connectors.filesystem.FileConnector.processDocuments(FileConnector.java:275)
at
org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:423)
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:564)
When I go to line 153 of DupFinderConnector I'm calling:
boolean isDuplicate = dataManager.insertData(timeStamp,
rcdCounter++, documentURI, outputDescription, authorityNameString,
document.getBinaryLength(), 1, hashsumHexValue, inputStream);
Added a log statement to print out all the parms. The only null one is
authorityNameString. First off, this error shows up in a few worker
threads and not all or in all crawl jobs. Any explanation or clue as to
what I should be looking for?
Thanks!
Re: Strange Exception
Posted by Karl Wright <da...@gmail.com>.
I would guess that dataManager is null. The only other possibility is
that document is null, and I don't think that can happen.
Karl
On Fri, Jun 3, 2011 at 4:11 PM, Farzad Valad <ho...@farzad.net> wrote:
> So I've been trying to figure this out for days now and still not even
> close. So I'm getting this in the log file:
>
> FATAL 2011-06-03 14:26:39,188 [Worker thread '22'] (WorkerThread.java:955) -
> Error tossed: null
> java.lang.NullPointerException
> at
> org.apache.manifoldcf.agents.output.dupfinder.DupFinderConnector.addOrReplaceDocument(DupFinderConnector.java:153)
> at
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.addOrReplaceDocument(IncrementalIngester.java:1433)
> at
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.performIngestion(IncrementalIngester.java:418)
> at
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:313)
> at
> org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocument(WorkerThread.java:1565)
> at
> org.apache.manifoldcf.crawler.connectors.filesystem.FileConnector.processDocuments(FileConnector.java:275)
> at
> org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector.processDocuments(BaseRepositoryConnector.java:423)
> at
> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:564)
>
> When I go to line 153 of DupFinderConnector I'm calling:
>
> boolean isDuplicate = dataManager.insertData(timeStamp,
> rcdCounter++, documentURI, outputDescription, authorityNameString,
> document.getBinaryLength(), 1, hashsumHexValue, inputStream);
>
> Added a log statement to print out all the parms. The only null one is
> authorityNameString. First off, this error shows up in a few worker threads
> and not all or in all crawl jobs. Any explanation or clue as to what I
> should be looking for?
>
> Thanks!
>