You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Karl Wright (JIRA)" <ji...@apache.org> on 2012/10/09 19:08:03 UTC

[jira] [Commented] (CONNECTORS-551) Documents from Wiki and JDBC connectors are removed whenever the agents process is started when continuous crawling

    [ https://issues.apache.org/jira/browse/CONNECTORS-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13472544#comment-13472544 ] 

Karl Wright commented on CONNECTORS-551:
----------------------------------------

I placed an exception where the document is getting deleted.  Here's the resulting trace:

{code}
java.lang.Exception: doc delete seen
        at org.apache.manifoldcf.agents.output.nullconnector.NullConnector.removeDocument(NullConnector.java:153)
        at org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.removeDocument(IncrementalIngester.java:1598)
        at org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentDeleteMultiple(IncrementalIngester.java:748)
        at org.apache.manifoldcf.crawler.system.DocumentCleanupThread.run(DocumentCleanupThread.java:191)
{code}

                
> Documents from Wiki and JDBC connectors are removed whenever the agents process is started when continuous crawling
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: CONNECTORS-551
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-551
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Framework crawler agent, JDBC connector, Wiki connector
>    Affects Versions: ManifoldCF 1.0
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>            Priority: Critical
>             Fix For: ManifoldCF 1.1
>
>
> "Indeed, when using the file system connector, Manifold works as it should. The agent can be stopped and restarted and the previously processed documents are retained. When I tried the JDBC (pointed to a MySQL DB) and Wiki connectors, however, I received the same results as yesterday - all documents are deleted as soon as the agent restarts (not on shutdown but when running the agent again after it has been stopped). 
> For the JDBC connector I could imagine that this may somehow be related to flawed seeding or version queries (although I believe them to be ok), but in the case of Wiki there are hardly any settings I believe I could have gotten wrong."

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira