You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Konstantin Avdeev (JIRA)" <ji...@apache.org> on 2016/10/06 07:04:20 UTC

[jira] [Commented] (CONNECTORS-1325) Invalid XML character causing job to abort

    [ https://issues.apache.org/jira/browse/CONNECTORS-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15551113#comment-15551113 ] 

Konstantin Avdeev commented on CONNECTORS-1325:
-----------------------------------------------

hello Karl,

we encountered the same issue recently with MCF 2.5. Unfortunately, the patch does not work as intended: documents having "bad" encoded chars are being fetched other and other again:

{code}
DEBUG 2016-10-05 14:45:56,600 (Worker thread '21') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 14:50:57,020 (Worker thread '31') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 14:55:57,277 (Worker thread '33') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 15:01:03,844 (Worker thread '35') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 15:06:04,024 (Worker thread '37') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 15:11:04,865 (Worker thread '34') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 15:16:05,434 (Worker thread '32') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
DEBUG 2016-10-05 15:21:07,335 (Worker thread '39') - SharePoint: Got a remote exception getting field values for site  library {1C165434-6546-4955-8BF2-05D9632AD202} document [/DevelopmentDocuments/Test/OP/VM2000248] - retrying
{code}

our "bad" char is the Record Separator (ASCII code: 30):
{code}
org.xml.sax.SAXParseException; lineNumber: 6; columnNumber: 15716; Character reference "&#30" is an invalid XML character. 
{code}

Could you please re-open the ticket? Or should I create a new one?
Thank you!


> Invalid XML character causing job to abort
> ------------------------------------------
>
>                 Key: CONNECTORS-1325
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1325
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: SharePoint connector
>    Affects Versions: ManifoldCF 2.3
>            Reporter: Phil
>            Assignee: Karl Wright
>            Priority: Blocker
>             Fix For: ManifoldCF 2.5
>
>         Attachments: CONNECTORS-1325-2.patch, CONNECTORS-1325.patch
>
>
> The following error is causing the Manifold job to abort, and subsequently the job not being able to finish.
> It would be good to have the crawler log this error, but not throw an exception which causes the entire job to stop.
> {code}
> ERROR 2016-06-21 19:01:54,562 (Worker thread '6') system.WorkerThread - Exception tossed: XML parsing error: Character reference "&#xD83D" is an invalid XML character.
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: XML parsing error: Character reference "&#xD83D" is an invalid XML character.
>         at org.apache.manifoldcf.core.common.XMLDoc.init(XMLDoc.java:390)
>         at org.apache.manifoldcf.core.common.XMLDoc.<init>(XMLDoc.java:286)
>         at org.apache.manifoldcf.crawler.connectors.sharepoint.SPSProxyHelper.getFieldValues(SPSProxyHelper.java:2039)
>         at org.apache.manifoldcf.crawler.connectors.sharepoint.SharePointRepository.processDocuments(SharePointRepository.java:974)
>         at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:399)
> Caused by: org.xml.sax.SAXParseException; lineNumber: 18; columnNumber: 64; Character reference "&#xD83D" is an invalid XML character.
>         at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
>         at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
>         at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121)
>         at org.apache.manifoldcf.core.common.XMLDoc.init(XMLDoc.java:359)
>         ... 4 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)