You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@manifoldcf.apache.org by Will Parkinson <pa...@gmail.com> on 2013/09/03 08:05:53 UTC

ManifoldCF - Log question

Hello

During my Sharepoint crawls i am seeing a lot of DEBUG messages like the
following:

DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its connection
limit - excluding
DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its connection
limit - excluding
DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its connection
limit - excluding
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its connection
limit - excluding
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its connection
limit - excluding
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its connection
limit - excluding
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
included
DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its connection
limit - excluding

What connection limit does "Row exceeds its connection limit - excluding"
refer to?  Does it mean that there are documents not being sent to the
output connector?

Cheers,

Will

Re: ManifoldCF - Log question

Posted by Will Parkinson <pa...@gmail.com>.
Thanks Karl!


On Tue, Sep 3, 2013 at 4:10 PM, Karl Wright <da...@gmail.com> wrote:

> Hi Will,
>
> This is the ManifoldCF scheduler in operation. It filters out documents
> temporarily from the list of documents it is processing because processing
> them would overweight one connection at the expense of others.  It will
> eventually process them at a more auspicious time.
>
> Karl
>
>
>
> On Tue, Sep 3, 2013 at 2:05 AM, Will Parkinson <pa...@gmail.com>wrote:
>
>> Hello
>>
>> During my Sharepoint crawls i am seeing a lot of DEBUG messages like the
>> following:
>>
>> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
>> included
>> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
>> connection limit - excluding
>>
>> What connection limit does "Row exceeds its connection limit - excluding"
>> refer to?  Does it mean that there are documents not being sent to the
>> output connector?
>>
>> Cheers,
>>
>> Will
>>
>
>

Re: ManifoldCF - Log question

Posted by Karl Wright <da...@gmail.com>.
Hi Will,

This is the ManifoldCF scheduler in operation. It filters out documents
temporarily from the list of documents it is processing because processing
them would overweight one connection at the expense of others.  It will
eventually process them at a more auspicious time.

Karl



On Tue, Sep 3, 2013 at 2:05 AM, Will Parkinson <pa...@gmail.com>wrote:

> Hello
>
> During my Sharepoint crawls i am seeing a lot of DEBUG messages like the
> following:
>
> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its
> connection limit - excluding
> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its
> connection limit - excluding
> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,879 (Thread-205545) -  Row exceeds its
> connection limit - excluding
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
> connection limit - excluding
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
> connection limit - excluding
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
> connection limit - excluding
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) - Checking if row should be
> included
> DEBUG 2013-09-03 16:01:19,880 (Thread-205545) -  Row exceeds its
> connection limit - excluding
>
> What connection limit does "Row exceeds its connection limit - excluding"
> refer to?  Does it mean that there are documents not being sent to the
> output connector?
>
> Cheers,
>
> Will
>