You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@manifoldcf.apache.org by Johan Persson <pe...@gmail.com> on 2012/10/15 18:28:30 UTC

Strange behaviour on internet free server

I'm getting strange behaviour from a test-server I've set up in a
Internet free environment.
Could this hinder Manifold from working properly?

Im using Sharepoint, AD and Solr-connections

Best Regards /J

Re: Strange behaviour on internet free server

Posted by Johan Persson <pe...@gmail.com>.
And that was the trick.

I'd tried with a star on the Path but not on the Metadata.

Now I'm struggeling to get the AD-connection right :)

I'll keep you posted

Thanks again

2012/10/16 Ahmet Arslan <io...@yahoo.com>

> Hi Johan,
>
> As Karl said your rules needs * at the end. You need to use 'Add Text'
> button to add * to rules. At the end of the day, you need to have these :
>
> Path Rules:
> Path Match = /Shared Documents/*
>
> Metadata:
> Path Match = /Shared Documents/*
>
>
> In other words you are hitting this warning :
>
> "If you don't add * to Patch match rule, your selected fields won't be
> used. In other words Path match rule /Documents won't match the document
> /Documents/ik_docs/diger/sorular.docx" [1]
>
> [1]
> http://manifoldcf.apache.org/release/release-1.0/en_US/end-user-documentation.html#sharepointrepository
>
> Please let's us know if you can get this working.
>
> Ahmet
>
> --- On Tue, 10/16/12, Karl Wright <da...@gmail.com> wrote:
>
> > From: Karl Wright <da...@gmail.com>
> > Subject: Re: Strange behaviour on internet free server
> > To: user@manifoldcf.apache.org
> > Date: Tuesday, October 16, 2012, 7:37 PM
> > Hi,
> >
> > Your inclusion rules seem to include a library, but no
> > documents.  You
> > need a document specification, e.g. "*".  Try adding a
> > new path and
> > including that at the end.
> >
> > Karl
> >
> > On Tue, Oct 16, 2012 at 12:34 PM, Johan Persson <perzzon.johan@gmail.com
> >
> > wrote:
> > > Hi!
> > >
> > > I've tried a lot of different setups but I've at least
> > once followed the
> > > guide properly.
> > > I've appended screenshots of the setups for the most
> > promising setup.
> > > This at least shows the filename of a file in my shared
> > documents in the
> > > MF-log-file.
> > > Nothing in the index though.
> > >
> > > Thanks for engaging in this matter
> > >
> > > /Johan
> >
>

Re: Strange behaviour on internet free server

Posted by Ahmet Arslan <io...@yahoo.com>.
Hi Johan,

As Karl said your rules needs * at the end. You need to use 'Add Text' button to add * to rules. At the end of the day, you need to have these :

Path Rules: 
Path Match = /Shared Documents/*

Metadata:
Path Match = /Shared Documents/*


In other words you are hitting this warning :

"If you don't add * to Patch match rule, your selected fields won't be used. In other words Path match rule /Documents won't match the document /Documents/ik_docs/diger/sorular.docx" [1]

[1] http://manifoldcf.apache.org/release/release-1.0/en_US/end-user-documentation.html#sharepointrepository

Please let's us know if you can get this working.

Ahmet

--- On Tue, 10/16/12, Karl Wright <da...@gmail.com> wrote:

> From: Karl Wright <da...@gmail.com>
> Subject: Re: Strange behaviour on internet free server
> To: user@manifoldcf.apache.org
> Date: Tuesday, October 16, 2012, 7:37 PM
> Hi,
> 
> Your inclusion rules seem to include a library, but no
> documents.  You
> need a document specification, e.g. "*".  Try adding a
> new path and
> including that at the end.
> 
> Karl
> 
> On Tue, Oct 16, 2012 at 12:34 PM, Johan Persson <pe...@gmail.com>
> wrote:
> > Hi!
> >
> > I've tried a lot of different setups but I've at least
> once followed the
> > guide properly.
> > I've appended screenshots of the setups for the most
> promising setup.
> > This at least shows the filename of a file in my shared
> documents in the
> > MF-log-file.
> > Nothing in the index though.
> >
> > Thanks for engaging in this matter
> >
> > /Johan
> 

Re: Strange behaviour on internet free server

Posted by Karl Wright <da...@gmail.com>.
Hi,

Your inclusion rules seem to include a library, but no documents.  You
need a document specification, e.g. "*".  Try adding a new path and
including that at the end.

Karl

On Tue, Oct 16, 2012 at 12:34 PM, Johan Persson <pe...@gmail.com> wrote:
> Hi!
>
> I've tried a lot of different setups but I've at least once followed the
> guide properly.
> I've appended screenshots of the setups for the most promising setup.
> This at least shows the filename of a file in my shared documents in the
> MF-log-file.
> Nothing in the index though.
>
> Thanks for engaging in this matter
>
> /Johan

Re: Strange behaviour on internet free server

Posted by Johan Persson <pe...@gmail.com>.
Hi!

I've tried a lot of different setups but I've at least once followed the
guide properly.
I've appended screenshots of the setups for the most promising setup.
This at least shows the filename of a file in my shared documents in the
MF-log-file.
Nothing in the index though.

Thanks for engaging in this matter

/Johan

Re: Strange behaviour on internet free server

Posted by Karl Wright <da...@gmail.com>.
That means that the job completes and is not aborted.

The configuration "error" is effectively only a warning.  I'd look
elsewhere (maybe in your inclusion rules?) for the problem...

Karl

On Tue, Oct 16, 2012 at 10:26 AM, Johan Persson <pe...@gmail.com> wrote:
> I'm uncertain.
> It gets status "Done" in the showjobstatus.jsp
> But no documents are indexed. That might very well be due to other
> problems in my setup though.
>
> / Johan

Re: Strange behaviour on internet free server

Posted by Ahmet Arslan <io...@yahoo.com>.
Hi Johan,

Can you share your Path Rules? There is an "Example: How to index a SharePoint 2010 Document Library" at end user documentation if you haven't reviewed already. 

http://manifoldcf.apache.org/release/release-1.0/en_US/end-user-documentation.html#sharepointrepository

Ahmet
--- On Tue, 10/16/12, Johan Persson <pe...@gmail.com> wrote:

> From: Johan Persson <pe...@gmail.com>
> Subject: Re: Strange behaviour on internet free server
> To: user@manifoldcf.apache.org
> Date: Tuesday, October 16, 2012, 5:26 PM
> I'm uncertain.
> It gets status "Done" in the showjobstatus.jsp
> But no documents are indexed. That might very well be due to
> other
> problems in my setup though.
> 
> / Johan
> 

Re: Strange behaviour on internet free server

Posted by Johan Persson <pe...@gmail.com>.
I'm uncertain.
It gets status "Done" in the showjobstatus.jsp
But no documents are indexed. That might very well be due to other
problems in my setup though.

/ Johan

Re: Strange behaviour on internet free server

Posted by Karl Wright <da...@gmail.com>.
Does this abort the job?

Karl

On Tue, Oct 16, 2012 at 10:15 AM, Johan Persson <pe...@gmail.com> wrote:
> Too bad :(
>
> Although I got the Calendar import working.as it seems.
> But when I try to index the shared documents I get a
> "org.apache.axis.ConfigurationException: No service named WebsSoap is available"
> I tried to search the previous maillist-entrys for the error but only
> found problems related problems in the initial stages of SH2010 (ca
> 0.5) implementation.
>
> Any good pointers?
>
> Fuller printout:
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter: AxisEngine::init
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Exit: AxisEngine::init
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
> org.apache.axis.i18n.resource::handleGetObject(transport00)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Transport is
> org.apache.axis.transport.http.HTTPTransport@5a468fa3
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter:
> Call::invoke(ns, meth, args)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - operation=name:
>     GetWebCollection
> returnQName: {http://schemas.microsoft.com/sharepoint/soap/}GetWebCollectionResult
> returnType:  {http://schemas.microsoft.com/sharepoint/soap/}>>GetWebCollectionResponse>GetWebCollectionResult
> returnClass: class
> com.microsoft.schemas.sharepoint.soap.GetWebCollectionResponseGetWebCollectionResult
> elementQName:null
> soapAction:  null
> style:       wrapped
> use:         literal
> numInParams: 0
> method:null
>
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - operation.getNumParams()=0
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter:
> Call::invoke(RPCElement)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter: SOAPPart
> ctor(FORM_SOAPENVELOPE)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
> org.apache.axis.i18n.resource::handleGetObject(setMsgForm)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Setting current
> message form to: FORM_SOAPENVELOPE (currentMessage is now
> org.apache.axis.message.SOAPEnvelope)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Exit: SOAPPart ctor()
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
> org.apache.axis.i18n.resource::handleGetObject(addBody00)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Adding body
> element to message...
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter: Call::invoke()
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - MessageContext:
> setTargetService(WebsSoap)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
> org.apache.axis.i18n.resource::handleGetObject(noService10)
> DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Exception:
> org.apache.axis.ConfigurationException: No service named WebsSoap is available
> org.apache.axis.ConfigurationException: No service named WebsSoap is available
>         at org.apache.manifoldcf.crawler.connectors.sharepoint.SPSProxyHelper$ResourceProvider.getService(SPSProxyHelper.java:2880)

Re: Strange behaviour on internet free server

Posted by Johan Persson <pe...@gmail.com>.
Too bad :(

Although I got the Calendar import working.as it seems.
But when I try to index the shared documents I get a
"org.apache.axis.ConfigurationException: No service named WebsSoap is available"
I tried to search the previous maillist-entrys for the error but only
found problems related problems in the initial stages of SH2010 (ca
0.5) implementation.

Any good pointers?

Fuller printout:
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter: AxisEngine::init
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Exit: AxisEngine::init
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
org.apache.axis.i18n.resource::handleGetObject(transport00)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Transport is
org.apache.axis.transport.http.HTTPTransport@5a468fa3
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter:
Call::invoke(ns, meth, args)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - operation=name:
    GetWebCollection
returnQName: {http://schemas.microsoft.com/sharepoint/soap/}GetWebCollectionResult
returnType:  {http://schemas.microsoft.com/sharepoint/soap/}>>GetWebCollectionResponse>GetWebCollectionResult
returnClass: class
com.microsoft.schemas.sharepoint.soap.GetWebCollectionResponseGetWebCollectionResult
elementQName:null
soapAction:  null
style:       wrapped
use:         literal
numInParams: 0
method:null

DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - operation.getNumParams()=0
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter:
Call::invoke(RPCElement)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter: SOAPPart
ctor(FORM_SOAPENVELOPE)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
org.apache.axis.i18n.resource::handleGetObject(setMsgForm)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Setting current
message form to: FORM_SOAPENVELOPE (currentMessage is now
org.apache.axis.message.SOAPEnvelope)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Exit: SOAPPart ctor()
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
org.apache.axis.i18n.resource::handleGetObject(addBody00)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Adding body
element to message...
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Enter: Call::invoke()
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - MessageContext:
setTargetService(WebsSoap)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') -
org.apache.axis.i18n.resource::handleGetObject(noService10)
DEBUG 2012-10-16 06:39:00,187 (Worker thread '9') - Exception:
org.apache.axis.ConfigurationException: No service named WebsSoap is available
org.apache.axis.ConfigurationException: No service named WebsSoap is available
	at org.apache.manifoldcf.crawler.connectors.sharepoint.SPSProxyHelper$ResourceProvider.getService(SPSProxyHelper.java:2880)

Re: Strange behaviour on internet free server

Posted by Karl Wright <da...@gmail.com>.
:-)  Until somebody starts selling support for ManifoldCF, I'm afraid
it is just us volunteers.

Karl

On Tue, Oct 16, 2012 at 2:54 AM, Johan Persson <pe...@gmail.com> wrote:
> Hmmm... Stupid me.
> I just restarted with a new Manifold-installation and seem to have
> missed to set the Sharepoint-version correctly. Thanks for pointing
> that out.
>
> BTW There is there by any chance a payed support number to call?
>
> / Johan
>
> 2012/10/16 Karl Wright <da...@gmail.com>:
>> If this is SharePoint 2010, you need to select SharePoint 4.0 (2010)
>> in the pulldown.  It looks like you have not done this, since your
>> seem to be trying to use the SharePoint dspsts service, which does not
>> work on SharePoint 2010.
>>
>> I don't know if this is the cause of your Solr problem, but it would
>> certainly prevent progress on a SharePoint crawl.
>>
>> Thanks,
>> Karl
>>
>> On Tue, Oct 16, 2012 at 2:31 AM, Johan Persson <pe...@gmail.com> wrote:
>>> Didn't get anything into solr. Also the job seem to end up in some
>>> kind of gridlock with solr. (Never terminating until the solr-process
>>> is )
>>>
>>> Read the Manifold log and found this at the bottom.
>>> Just thought that the reason for the strange behaviour was that a DTD
>>> or similar was not obtained.
>>>
>>> "DEBUG 2012-10-15 09:23:50,531 (Worker thread '1') - Mapping Exception
>>> to AxisFault
>>> AxisFault
>>>  faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Client.Dsp.Syntax
>>>  faultSubcode:
>>>  faultString: Request is empty.
>>>  faultActor:
>>>  faultNode:
>>>  faultDetail:
>>>         {http://xml.apache.org/axis/}stackTrace:Request is empty.
>>> ...
>>> ...
>>>
>>>  WARN 2012-10-15 09:23:50,551 (Worker thread '1') - Service
>>> interruption reported for job 1350317841332 connection 'Sharepoint':
>>> Remote procedure exception: Request is empty.
>>> DEBUG 2012-10-15 09:23:58,499 (Idle cleanup thread) - Checking for
>>> connections, idleTimeout: 1350318178499
>>> "

Re: Strange behaviour on internet free server

Posted by Johan Persson <pe...@gmail.com>.
Hmmm... Stupid me.
I just restarted with a new Manifold-installation and seem to have
missed to set the Sharepoint-version correctly. Thanks for pointing
that out.

BTW There is there by any chance a payed support number to call?

/ Johan

2012/10/16 Karl Wright <da...@gmail.com>:
> If this is SharePoint 2010, you need to select SharePoint 4.0 (2010)
> in the pulldown.  It looks like you have not done this, since your
> seem to be trying to use the SharePoint dspsts service, which does not
> work on SharePoint 2010.
>
> I don't know if this is the cause of your Solr problem, but it would
> certainly prevent progress on a SharePoint crawl.
>
> Thanks,
> Karl
>
> On Tue, Oct 16, 2012 at 2:31 AM, Johan Persson <pe...@gmail.com> wrote:
>> Didn't get anything into solr. Also the job seem to end up in some
>> kind of gridlock with solr. (Never terminating until the solr-process
>> is )
>>
>> Read the Manifold log and found this at the bottom.
>> Just thought that the reason for the strange behaviour was that a DTD
>> or similar was not obtained.
>>
>> "DEBUG 2012-10-15 09:23:50,531 (Worker thread '1') - Mapping Exception
>> to AxisFault
>> AxisFault
>>  faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Client.Dsp.Syntax
>>  faultSubcode:
>>  faultString: Request is empty.
>>  faultActor:
>>  faultNode:
>>  faultDetail:
>>         {http://xml.apache.org/axis/}stackTrace:Request is empty.
>> ...
>> ...
>>
>>  WARN 2012-10-15 09:23:50,551 (Worker thread '1') - Service
>> interruption reported for job 1350317841332 connection 'Sharepoint':
>> Remote procedure exception: Request is empty.
>> DEBUG 2012-10-15 09:23:58,499 (Idle cleanup thread) - Checking for
>> connections, idleTimeout: 1350318178499
>> "

Re: Strange behaviour on internet free server

Posted by Karl Wright <da...@gmail.com>.
If this is SharePoint 2010, you need to select SharePoint 4.0 (2010)
in the pulldown.  It looks like you have not done this, since your
seem to be trying to use the SharePoint dspsts service, which does not
work on SharePoint 2010.

I don't know if this is the cause of your Solr problem, but it would
certainly prevent progress on a SharePoint crawl.

Thanks,
Karl

On Tue, Oct 16, 2012 at 2:31 AM, Johan Persson <pe...@gmail.com> wrote:
> Didn't get anything into solr. Also the job seem to end up in some
> kind of gridlock with solr. (Never terminating until the solr-process
> is )
>
> Read the Manifold log and found this at the bottom.
> Just thought that the reason for the strange behaviour was that a DTD
> or similar was not obtained.
>
> "DEBUG 2012-10-15 09:23:50,531 (Worker thread '1') - Mapping Exception
> to AxisFault
> AxisFault
>  faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Client.Dsp.Syntax
>  faultSubcode:
>  faultString: Request is empty.
>  faultActor:
>  faultNode:
>  faultDetail:
>         {http://xml.apache.org/axis/}stackTrace:Request is empty.
> ...
> ...
>
>  WARN 2012-10-15 09:23:50,551 (Worker thread '1') - Service
> interruption reported for job 1350317841332 connection 'Sharepoint':
> Remote procedure exception: Request is empty.
> DEBUG 2012-10-15 09:23:58,499 (Idle cleanup thread) - Checking for
> connections, idleTimeout: 1350318178499
> "

Re: Strange behaviour on internet free server

Posted by Johan Persson <pe...@gmail.com>.
Didn't get anything into solr. Also the job seem to end up in some
kind of gridlock with solr. (Never terminating until the solr-process
is )

Read the Manifold log and found this at the bottom.
Just thought that the reason for the strange behaviour was that a DTD
or similar was not obtained.

"DEBUG 2012-10-15 09:23:50,531 (Worker thread '1') - Mapping Exception
to AxisFault
AxisFault
 faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Client.Dsp.Syntax
 faultSubcode:
 faultString: Request is empty.
 faultActor:
 faultNode:
 faultDetail:
	{http://xml.apache.org/axis/}stackTrace:Request is empty.
...
...

 WARN 2012-10-15 09:23:50,551 (Worker thread '1') - Service
interruption reported for job 1350317841332 connection 'Sharepoint':
Remote procedure exception: Request is empty.
DEBUG 2012-10-15 09:23:58,499 (Idle cleanup thread) - Checking for
connections, idleTimeout: 1350318178499
"

Re: Strange behaviour on internet free server

Posted by Karl Wright <da...@gmail.com>.
I take it by "internet free" you mean a local network that is not
connected to the internet?

There should be no reason why ManifoldCF would not operate in such an
environment.  Can you describe the strange behavior you have been
seeing?

Karl

On Mon, Oct 15, 2012 at 12:28 PM, Johan Persson <pe...@gmail.com> wrote:
> I'm getting strange behaviour from a test-server I've set up in a
> Internet free environment.
> Could this hinder Manifold from working properly?
>
> Im using Sharepoint, AD and Solr-connections
>
> Best Regards /J