You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Arcadius Ahouansou (JIRA)" <ji...@apache.org> on 2015/06/05 01:03:38 UTC

[jira] [Comment Edited] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered

    [ https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573750#comment-14573750 ] 

Arcadius Ahouansou edited comment on CONNECTORS-1191 at 6/4/15 11:03 PM:
-------------------------------------------------------------------------

Got some log entries:
{code}

$ cat manifoldcf.log.12 | grep 1433374857580
DEBUG 2015-06-03 23:48:20,721 (Worker thread '82') - Worker thread processing documents: 1433374857580
DEBUG 2015-06-03 23:48:20,722 (Worker thread '82') - Worker thread about to process {1433374857580 }
DEBUG 2015-06-03 23:48:21,405 (Worker thread '99') - Worker thread processing documents: 1433374857580
DEBUG 2015-06-03 23:48:21,407 (Worker thread '99') - Worker thread about to process {1433374857580 }

$ cat manifoldcf.log.11 | grep 1433374857580
DEBUG 2015-06-04 00:17:31,231 (Worker thread '99') -  Adding 1433374857580 to finishList
DEBUG 2015-06-04 00:17:31,231 (Worker thread '99') - Finishing documents {1433374857580 }
DEBUG 2015-06-04 00:18:37,459 (Worker thread '82') -  Adding 1433374857580 to finishList
DEBUG 2015-06-04 00:18:37,459 (Worker thread '82') - Finishing documents {1433374857580 }
DEBUG 2015-06-04 00:19:16,946 (Worker thread '82') -  Marking completed {1433374857580 }
DEBUG 2015-06-04 00:19:38,967 (Worker thread '99') -  Marking completed {1433374857580 }
ERROR 2015-06-04 00:19:47,486 (Worker thread '99') - Exception tossed: Unexpected jobqueue status - record id 1433374857580, expecting active status, saw 2
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record id 1433374857580, expecting active status, saw 2
{code}

This clearly shows that we have thread 99 and 82 processing the very same document.
I have attached a screenshot of the schedule as well.
Is it possible that another instance of the jobs is scheduled while one is already running?

BTW: Some jobs (see screenshot) have status "Waiting" ... I wonder what that means.

Thanks.




was (Author: arcadius):
Got some log entries:
{code}

$ cat manifoldcf.log.12 | grep 1433374857580
DEBUG 2015-06-03 23:48:20,721 (Worker thread '82') - Worker thread processing documents: 1433374857580
DEBUG 2015-06-03 23:48:20,722 (Worker thread '82') - Worker thread about to process {1433374857580 }
DEBUG 2015-06-03 23:48:21,405 (Worker thread '99') - Worker thread processing documents: 1433374857580
DEBUG 2015-06-03 23:48:21,407 (Worker thread '99') - Worker thread about to process {1433374857580 }

$ cat manifoldcf.log.11 | grep 1433374857580
DEBUG 2015-06-04 00:17:31,231 (Worker thread '99') -  Adding 1433374857580 to finishList
DEBUG 2015-06-04 00:17:31,231 (Worker thread '99') - Finishing documents {1433374857580 }
DEBUG 2015-06-04 00:18:37,459 (Worker thread '82') -  Adding 1433374857580 to finishList
DEBUG 2015-06-04 00:18:37,459 (Worker thread '82') - Finishing documents {1433374857580 }
DEBUG 2015-06-04 00:19:16,946 (Worker thread '82') -  Marking completed {1433374857580 }
DEBUG 2015-06-04 00:19:38,967 (Worker thread '99') -  Marking completed {1433374857580 }
ERROR 2015-06-04 00:19:47,486 (Worker thread '99') - Exception tossed: Unexpected jobqueue status - record id 1433374857580, expecting active status, saw 2
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record id 1433374857580, expecting active status, saw 2
{code}

This clearly shows that we have thread 99 and 82 processing the very same document.
I have attached a screenshot of the schedule as well.
Is it possible that another instance of the jobs is scheduled while one is already running?

BTW: Some jobs have status "Waiting" ... I wonder what that means.

Thanks.



> ManifoldCFException: Unexpected job status encountered
> ------------------------------------------------------
>
>                 Key: CONNECTORS-1191
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Web connector
>    Affects Versions: ManifoldCF 2.0.2
>         Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>            Reporter: Arcadius Ahouansou
>            Assignee: Karl Wright
>            Priority: Critical
>             Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
>         Attachments: 1433374857580-jobs.png, 1433374857580-schedule.png, CONNECTORS-1191-2.patch, CONNECTORS-1191.patch, manifoldcf2.0.2.log, stuffer-thread-manifoldcf.log, unexpected-jobqueue.png
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of 
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job status encountered: 34
> 	at org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> 	at org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> 	at org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)