You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@manifoldcf.apache.org by Karl Wright <da...@gmail.com> on 2014/08/12 13:38:52 UTC
Re:
Hi Salih,
I'm afraid you will have to give more information than that. What error
pages are you seeing? When do you see them?
Karl
On Tue, Aug 12, 2014 at 7:32 AM, Salih Sen <sa...@dilisim.com> wrote:
> Hi,
>
> We have two ManifodCF instances running on two different machines for
> crawling Sharepoint 2010 sites to Solr. One of those instances is just used
> for availability (mcf-authority-service, only no jobs).
>
> Problem is on both instances mcf-crawler-ui starts displaying error pages
> or directory indexes. Authority service is not effected though. It works
> just fine. I'm not sure if crawl jobs running or not.
>
> We are using ManifoldCF trunk (svn r1577017) with Postgresql 8.4.14
>
> Has anyone encountered this before? Any ideas about the cause of the
> problem.
>
> Thanks.
>
> --
>
> Salih Şen
>
> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
> Sti.
>
> email: salih@dilisim.com <ba...@dilisim.com>
>
> Tel: 0 222 330 20 21
>
> GSM: 0 507 296 15 51
>
Re:
Posted by Karl Wright <da...@gmail.com>.
OutOfMemoryError
Karl
On Fri, Aug 15, 2014 at 1:04 PM, Salih Sen <sa...@dilisim.com> wrote:
> Hi Karl,
>
> I set up a cron job to check lsof -p <process_id> | wc everyday. So far
> It's been stable on 582 for two days.
>
> I couldn't find any lines in log files about memory. At least with cat
> manifoldcf.log* | grep -i memory. Do you have any idea what would the
> message look like?
>
> Thanks.
>
>
>
>
> On Tue, Aug 12, 2014 at 3:04 PM, Karl Wright <da...@gmail.com> wrote:
>
>> Hi Salih,
>>
>> Offhand it sounds like there must be some resource leak or something. If
>> you are running on a Linux system, can you periodically do an "lsof -p
>> <process_id> | wc" to see if the handle count is growing. You can also
>> look at the ManifoldCF log file to see if there are any indications of
>> memory exhaustion etc.
>>
>> Thanks,
>> Karl
>>
>>
>>
>> On Tue, Aug 12, 2014 at 7:54 AM, Salih Sen <sa...@dilisim.com> wrote:
>>
>>> Hi Karl,
>>>
>>> Sorry I forgot to mention few details.
>>>
>>> They appear quite long time after ManfioldCF starts running. I would say
>>> two weeks at least probably more. I haven't noted when was the last time
>>> they appeared so I'm not exactly sure.
>>>
>>> Problem disappears after restarting ManifoldCF.
>>>
>>> Here are the screenshots:
>>> http://imgur.com/XEQhiMK
>>> http://imgur.com/lK7NqLM
>>>
>>>
>>>
>>>
>>> On Tue, Aug 12, 2014 at 2:38 PM, Karl Wright <da...@gmail.com> wrote:
>>>
>>>> Hi Salih,
>>>>
>>>> I'm afraid you will have to give more information than that. What
>>>> error pages are you seeing? When do you see them?
>>>>
>>>> Karl
>>>>
>>>>
>>>>
>>>> On Tue, Aug 12, 2014 at 7:32 AM, Salih Sen <sa...@dilisim.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> We have two ManifodCF instances running on two different machines for
>>>>> crawling Sharepoint 2010 sites to Solr. One of those instances is just used
>>>>> for availability (mcf-authority-service, only no jobs).
>>>>>
>>>>> Problem is on both instances mcf-crawler-ui starts displaying error
>>>>> pages or directory indexes. Authority service is not effected though. It
>>>>> works just fine. I'm not sure if crawl jobs running or not.
>>>>>
>>>>> We are using ManifoldCF trunk (svn r1577017) with Postgresql 8.4.14
>>>>>
>>>>> Has anyone encountered this before? Any ideas about the cause of the
>>>>> problem.
>>>>>
>>>>> Thanks.
>>>>>
>>>>> --
>>>>>
>>>>> Salih Şen
>>>>>
>>>>> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret
>>>>> Ltd. Sti.
>>>>>
>>>>> email: salih@dilisim.com <ba...@dilisim.com>
>>>>>
>>>>> Tel: 0 222 330 20 21
>>>>>
>>>>> GSM: 0 507 296 15 51
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>>
>>> Salih Şen
>>>
>>> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret
>>> Ltd. Sti.
>>>
>>> email: salih@dilisim.com <ba...@dilisim.com>
>>>
>>> Tel: 0 222 330 20 21
>>>
>>> GSM: 0 507 296 15 51
>>>
>>
>>
>
>
> --
>
> Salih Şen
>
> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
> Sti.
>
> email: salih@dilisim.com <ba...@dilisim.com>
>
> Tel: 0 222 330 20 21
>
> GSM: 0 507 296 15 51
>
Re:
Posted by Salih Sen <sa...@dilisim.com>.
Hi Karl,
I set up a cron job to check lsof -p <process_id> | wc everyday. So far
It's been stable on 582 for two days.
I couldn't find any lines in log files about memory. At least with cat
manifoldcf.log* | grep -i memory. Do you have any idea what would the
message look like?
Thanks.
On Tue, Aug 12, 2014 at 3:04 PM, Karl Wright <da...@gmail.com> wrote:
> Hi Salih,
>
> Offhand it sounds like there must be some resource leak or something. If
> you are running on a Linux system, can you periodically do an "lsof -p
> <process_id> | wc" to see if the handle count is growing. You can also
> look at the ManifoldCF log file to see if there are any indications of
> memory exhaustion etc.
>
> Thanks,
> Karl
>
>
>
> On Tue, Aug 12, 2014 at 7:54 AM, Salih Sen <sa...@dilisim.com> wrote:
>
>> Hi Karl,
>>
>> Sorry I forgot to mention few details.
>>
>> They appear quite long time after ManfioldCF starts running. I would say
>> two weeks at least probably more. I haven't noted when was the last time
>> they appeared so I'm not exactly sure.
>>
>> Problem disappears after restarting ManifoldCF.
>>
>> Here are the screenshots:
>> http://imgur.com/XEQhiMK
>> http://imgur.com/lK7NqLM
>>
>>
>>
>>
>> On Tue, Aug 12, 2014 at 2:38 PM, Karl Wright <da...@gmail.com> wrote:
>>
>>> Hi Salih,
>>>
>>> I'm afraid you will have to give more information than that. What error
>>> pages are you seeing? When do you see them?
>>>
>>> Karl
>>>
>>>
>>>
>>> On Tue, Aug 12, 2014 at 7:32 AM, Salih Sen <sa...@dilisim.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> We have two ManifodCF instances running on two different machines for
>>>> crawling Sharepoint 2010 sites to Solr. One of those instances is just used
>>>> for availability (mcf-authority-service, only no jobs).
>>>>
>>>> Problem is on both instances mcf-crawler-ui starts displaying error
>>>> pages or directory indexes. Authority service is not effected though. It
>>>> works just fine. I'm not sure if crawl jobs running or not.
>>>>
>>>> We are using ManifoldCF trunk (svn r1577017) with Postgresql 8.4.14
>>>>
>>>> Has anyone encountered this before? Any ideas about the cause of the
>>>> problem.
>>>>
>>>> Thanks.
>>>>
>>>> --
>>>>
>>>> Salih Şen
>>>>
>>>> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret
>>>> Ltd. Sti.
>>>>
>>>> email: salih@dilisim.com <ba...@dilisim.com>
>>>>
>>>> Tel: 0 222 330 20 21
>>>>
>>>> GSM: 0 507 296 15 51
>>>>
>>>
>>>
>>
>>
>> --
>>
>> Salih Şen
>>
>> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
>> Sti.
>>
>> email: salih@dilisim.com <ba...@dilisim.com>
>>
>> Tel: 0 222 330 20 21
>>
>> GSM: 0 507 296 15 51
>>
>
>
--
Salih Şen
Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
Sti.
email: salih@dilisim.com <ba...@dilisim.com>
Tel: 0 222 330 20 21
GSM: 0 507 296 15 51
Re:
Posted by Karl Wright <da...@gmail.com>.
Hi Salih,
Offhand it sounds like there must be some resource leak or something. If
you are running on a Linux system, can you periodically do an "lsof -p
<process_id> | wc" to see if the handle count is growing. You can also
look at the ManifoldCF log file to see if there are any indications of
memory exhaustion etc.
Thanks,
Karl
On Tue, Aug 12, 2014 at 7:54 AM, Salih Sen <sa...@dilisim.com> wrote:
> Hi Karl,
>
> Sorry I forgot to mention few details.
>
> They appear quite long time after ManfioldCF starts running. I would say
> two weeks at least probably more. I haven't noted when was the last time
> they appeared so I'm not exactly sure.
>
> Problem disappears after restarting ManifoldCF.
>
> Here are the screenshots:
> http://imgur.com/XEQhiMK
> http://imgur.com/lK7NqLM
>
>
>
>
> On Tue, Aug 12, 2014 at 2:38 PM, Karl Wright <da...@gmail.com> wrote:
>
>> Hi Salih,
>>
>> I'm afraid you will have to give more information than that. What error
>> pages are you seeing? When do you see them?
>>
>> Karl
>>
>>
>>
>> On Tue, Aug 12, 2014 at 7:32 AM, Salih Sen <sa...@dilisim.com> wrote:
>>
>>> Hi,
>>>
>>> We have two ManifodCF instances running on two different machines for
>>> crawling Sharepoint 2010 sites to Solr. One of those instances is just used
>>> for availability (mcf-authority-service, only no jobs).
>>>
>>> Problem is on both instances mcf-crawler-ui starts displaying error
>>> pages or directory indexes. Authority service is not effected though. It
>>> works just fine. I'm not sure if crawl jobs running or not.
>>>
>>> We are using ManifoldCF trunk (svn r1577017) with Postgresql 8.4.14
>>>
>>> Has anyone encountered this before? Any ideas about the cause of the
>>> problem.
>>>
>>> Thanks.
>>>
>>> --
>>>
>>> Salih Şen
>>>
>>> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret
>>> Ltd. Sti.
>>>
>>> email: salih@dilisim.com <ba...@dilisim.com>
>>>
>>> Tel: 0 222 330 20 21
>>>
>>> GSM: 0 507 296 15 51
>>>
>>
>>
>
>
> --
>
> Salih Şen
>
> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
> Sti.
>
> email: salih@dilisim.com <ba...@dilisim.com>
>
> Tel: 0 222 330 20 21
>
> GSM: 0 507 296 15 51
>
Re:
Posted by Salih Sen <sa...@dilisim.com>.
Hi Karl,
Sorry I forgot to mention few details.
They appear quite long time after ManfioldCF starts running. I would say
two weeks at least probably more. I haven't noted when was the last time
they appeared so I'm not exactly sure.
Problem disappears after restarting ManifoldCF.
Here are the screenshots:
http://imgur.com/XEQhiMK
http://imgur.com/lK7NqLM
On Tue, Aug 12, 2014 at 2:38 PM, Karl Wright <da...@gmail.com> wrote:
> Hi Salih,
>
> I'm afraid you will have to give more information than that. What error
> pages are you seeing? When do you see them?
>
> Karl
>
>
>
> On Tue, Aug 12, 2014 at 7:32 AM, Salih Sen <sa...@dilisim.com> wrote:
>
>> Hi,
>>
>> We have two ManifodCF instances running on two different machines for
>> crawling Sharepoint 2010 sites to Solr. One of those instances is just used
>> for availability (mcf-authority-service, only no jobs).
>>
>> Problem is on both instances mcf-crawler-ui starts displaying error pages
>> or directory indexes. Authority service is not effected though. It works
>> just fine. I'm not sure if crawl jobs running or not.
>>
>> We are using ManifoldCF trunk (svn r1577017) with Postgresql 8.4.14
>>
>> Has anyone encountered this before? Any ideas about the cause of the
>> problem.
>>
>> Thanks.
>>
>> --
>>
>> Salih Şen
>>
>> Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
>> Sti.
>>
>> email: salih@dilisim.com <ba...@dilisim.com>
>>
>> Tel: 0 222 330 20 21
>>
>> GSM: 0 507 296 15 51
>>
>
>
--
Salih Şen
Dilişim Bilgi Bilgisayar ve İletişim Teknolojileri Sanayi ve Ticaret Ltd.
Sti.
email: salih@dilisim.com <ba...@dilisim.com>
Tel: 0 222 330 20 21
GSM: 0 507 296 15 51