[jira] Updated: (CONNECTORS-27) Add support for observation to the crawler agent

["Ralph Benjamin Ruijs (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CONNECTORS-27?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ralph Benjamin Ruijs updated CONNECTORS-27:
-------------------------------------------

    Attachment: Added_observation_logic_to_the_crawler.patch

This patch adds support for observation to the crawler. It creates a new thread in the crawler agent which polls the active jobs. A connector needs to implement the actual observation and gets a reserved connection to listen on.

> Add support for observation to the crawler agent
> ------------------------------------------------
>
>                 Key: CONNECTORS-27
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-27
>             Project: Lucene Connector Framework
>          Issue Type: New Feature
>          Components: Framework crawler agent
>            Reporter: Ralph Benjamin Ruijs
>            Priority: Minor
>         Attachments: Added_observation_logic_to_the_crawler.patch
>
>
> When crawling a large repository, it could take a lot of time before changes are propagated to Solr. You can add an event listener to the repository, and be notified about changes. The crawler will ensure you have a complete copy in case of missed events.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira