[jira] [Comment Edited] (CONNECTORS-1747) Add a property to disable logging hop count to database

["Mingchun Zhao (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CONNECTORS-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723328#comment-17723328 ] 

Mingchun Zhao edited comment on CONNECTORS-1747 at 5/17/23 3:18 AM:
--------------------------------------------------------------------

Hello,

I changed spec for new property as below. Could you please review the attached new patch?

<property name="org.apache.manifoldcf.crawler.jobs.storehopcount" value="false"/>

You can use this property to disable logging hopcount to database only for jobs with hopcount mode "keep unreachable documents, forever" specified in the "Hop Filters" tab.


was (Author: mingchun.zhao):
Hello,

I changed spec for new property as below. Could you please review the attached new patch [^JobManager.java.patch2]?

<property name="org.apache.manifoldcf.crawler.jobs.storehopcount" value="false"/>

You can use this property to disable logging hopcount to database only for jobs with hopcount mode "keep unreachable documents, forever" specified in the "Hop Filters" tab.

> Add a property to disable logging hop count to database
> -------------------------------------------------------
>
>                 Key: CONNECTORS-1747
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1747
>             Project: ManifoldCF
>          Issue Type: Improvement
>            Reporter: Mingchun Zhao
>            Priority: Major
>         Attachments: JobManager.java.patch
>
>
> If we do not require “Hop Filters“ feature, we need to consider to disable logging records related to hopcount to database like "intrinsiclink" and "hopcount" tables. This can increase throughput and reduce the rate of growth of the database.
> I will try to create a patch for this.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)