You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Anupam Bhattacharya (JIRA)" <ji...@apache.org> on 2012/07/04 12:04:34 UTC
[jira] [Created] (CONNECTORS-488) The cache settings for ManifoldCF
Authority Service should be configurable
Anupam Bhattacharya created CONNECTORS-488:
----------------------------------------------
Summary: The cache settings for ManifoldCF Authority Service should be configurable
Key: CONNECTORS-488
URL: https://issues.apache.org/jira/browse/CONNECTORS-488
Project: ManifoldCF
Issue Type: Improvement
Components: Authority Service, Documentum connector
Affects Versions: ManifoldCF 0.5.1
Environment: Any Platform
Reporter: Anupam Bhattacharya
Priority: Minor
Fix For: ManifoldCF next
Below is the conversation which helped to resolve the problem. The actual Mail Archive URL is http://mail-archives.apache.org/mod_mbox/manifoldcf-user/201207.mbox/browser.
-----------------------------------------------------------------------
Many Thanks!! I changed the value & did rebuild of ManifoldCF which helped
to solve the issue.
Regards
Anupam
On Tue, Jul 3, 2012 at 4:24 PM, Shinichiro Abe
<sh...@gmail.com>wrote:
> Hi,
>
> I think you see the following line if you configure cache life time.
>
> source:
> org.apache.manifoldcf.crawler.authorities.DCTM.AuthorityConnector.java
>
> protected static long responseLifetime = 60000L; <--this value
>
>
> I think ActiveDirectoryAuthority.java code helps this.
>
> Regards,
> Shinichiro Abe
>
> On 2012/07/03, at 19:44, Anupam Bhattacharya wrote:
>
> > Sorry i didn't mention that clearly.
> >
> > I was just trying to figure out from the SVN Code where the 1 min
> timeout changes have been kept.
> > By my best guess, I can see a line which must be doing this 1 min
> timeout changes in
> http://svn.apache.org/repos/asf/manifoldcf/trunk/framework/pull-agent/src/main/java/org/apache/manifoldcf/crawler/system/ExpireStufferThread.java
> >
> > // If there are no documents at all, then we can sleep for a while.
> > // The theory is that we need to allow stuff to
> accumulate.
> > if (descs.length == 0)
> > {
> > ManifoldCF.sleep(60000L); // 1 minute
> > continue;
> > }
> >
> > Pls. confirm if i am on the right direction.
> >
> > Thanks
> > Anupam
> >
> > On Tue, Jul 3, 2012 at 3:51 PM, Shinichiro Abe <
> shinichiro.abe.1@gmail.com> wrote:
> > Hi,
> > Oh sorry, I told about Active Directory Authority Services.
> > Now there is not a place to configure cache life time
> > in Documentum Authority Services.
> >
> > Shinichiro Abe
> > On 2012/07/03, at 19:07, Anupam Bhattacharya wrote:
> >
> > > Hi,
> > >
> > > I am using ManifoldCF for Documentum Repository & Documentum Authority
> Services. How can I configure cache life time settings in this case when
> Active directory is not present ?
> > >
> > > Regards
> > > Anupam
> > >
> > > On Tue, Jul 3, 2012 at 3:32 PM, Shinichiro Abe <
> shinichiro.abe.1@gmail.com> wrote:
> > > Hi,
> > >
> > > > Can I configure these timeout settings value to anything like 60min
> or 1 day etc ?
> > > Yes, you can configure cache life time,
> > > in which tokens are cached after last access(user's last access) to
> the Active Directory.
> > > I think this value might as well be set to about 60min, 1day is too
> long.
> > >
> > > Regards,
> > > Shinichiro Abe
> > >
> > > On 2012/07/03, at 18:15, Anupam Bhattacharya wrote:
> > >
> > > > Hello Karl,
> > > >
> > > > First of all congratulations for ManifoldCF graduation to Apache
> Projects & thanks for all the help you provided during my development
> previously through this forum.
> > > >
> > > > I have recently come across a Performance problem due to ManifoldCF
> Authority service. After including authority service the Query Response
> times increases a lot. After doing some inspection i found that ManifoldCF
> doesn't cache User Token's after 1 min. (
> http://search-lucene.com/m/YqXPHki0Dv/v=threaded).
> > > >
> > > > Can I configure these timeout settings value to anything like 60min
> or 1 day etc ?
> > > >
> > > > Regards
> > > > Anupam
> > > >
> > > >
> > > >
> > >
> >
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CONNECTORS-488) The cache settings for all
caching ManifoldCF connectors that cache should be configurable
Posted by "Karl Wright (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karl Wright updated CONNECTORS-488:
-----------------------------------
Component/s: Meridio connector
LiveLink connector
Assignee: Karl Wright
Summary: The cache settings for all caching ManifoldCF connectors that cache should be configurable (was: The cache settings for ManifoldCF Authority Service should be configurable)
I think all authority connectors that have caching need to have a way of controlling it.
> The cache settings for all caching ManifoldCF connectors that cache should be configurable
> ------------------------------------------------------------------------------------------
>
> Key: CONNECTORS-488
> URL: https://issues.apache.org/jira/browse/CONNECTORS-488
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Authority Service, Documentum connector, LiveLink connector, Meridio connector
> Affects Versions: ManifoldCF 0.5.1
> Environment: Any Platform
> Reporter: Anupam Bhattacharya
> Assignee: Karl Wright
> Priority: Minor
> Fix For: ManifoldCF next
>
>
> Below is the conversation which helped to resolve the problem. The actual Mail Archive URL is http://mail-archives.apache.org/mod_mbox/manifoldcf-user/201207.mbox/browser.
> -----------------------------------------------------------------------
> Many Thanks!! I changed the value & did rebuild of ManifoldCF which helped
> to solve the issue.
> Regards
> Anupam
> On Tue, Jul 3, 2012 at 4:24 PM, Shinichiro Abe
> <sh...@gmail.com>wrote:
> > Hi,
> >
> > I think you see the following line if you configure cache life time.
> >
> > source:
> > org.apache.manifoldcf.crawler.authorities.DCTM.AuthorityConnector.java
> >
> > protected static long responseLifetime = 60000L; <--this value
> >
> >
> > I think ActiveDirectoryAuthority.java code helps this.
> >
> > Regards,
> > Shinichiro Abe
> >
> > On 2012/07/03, at 19:44, Anupam Bhattacharya wrote:
> >
> > > Sorry i didn't mention that clearly.
> > >
> > > I was just trying to figure out from the SVN Code where the 1 min
> > timeout changes have been kept.
> > > By my best guess, I can see a line which must be doing this 1 min
> > timeout changes in
> > http://svn.apache.org/repos/asf/manifoldcf/trunk/framework/pull-agent/src/main/java/org/apache/manifoldcf/crawler/system/ExpireStufferThread.java
> > >
> > > // If there are no documents at all, then we can sleep for a while.
> > > // The theory is that we need to allow stuff to
> > accumulate.
> > > if (descs.length == 0)
> > > {
> > > ManifoldCF.sleep(60000L); // 1 minute
> > > continue;
> > > }
> > >
> > > Pls. confirm if i am on the right direction.
> > >
> > > Thanks
> > > Anupam
> > >
> > > On Tue, Jul 3, 2012 at 3:51 PM, Shinichiro Abe <
> > shinichiro.abe.1@gmail.com> wrote:
> > > Hi,
> > > Oh sorry, I told about Active Directory Authority Services.
> > > Now there is not a place to configure cache life time
> > > in Documentum Authority Services.
> > >
> > > Shinichiro Abe
> > > On 2012/07/03, at 19:07, Anupam Bhattacharya wrote:
> > >
> > > > Hi,
> > > >
> > > > I am using ManifoldCF for Documentum Repository & Documentum Authority
> > Services. How can I configure cache life time settings in this case when
> > Active directory is not present ?
> > > >
> > > > Regards
> > > > Anupam
> > > >
> > > > On Tue, Jul 3, 2012 at 3:32 PM, Shinichiro Abe <
> > shinichiro.abe.1@gmail.com> wrote:
> > > > Hi,
> > > >
> > > > > Can I configure these timeout settings value to anything like 60min
> > or 1 day etc ?
> > > > Yes, you can configure cache life time,
> > > > in which tokens are cached after last access(user's last access) to
> > the Active Directory.
> > > > I think this value might as well be set to about 60min, 1day is too
> > long.
> > > >
> > > > Regards,
> > > > Shinichiro Abe
> > > >
> > > > On 2012/07/03, at 18:15, Anupam Bhattacharya wrote:
> > > >
> > > > > Hello Karl,
> > > > >
> > > > > First of all congratulations for ManifoldCF graduation to Apache
> > Projects & thanks for all the help you provided during my development
> > previously through this forum.
> > > > >
> > > > > I have recently come across a Performance problem due to ManifoldCF
> > Authority service. After including authority service the Query Response
> > times increases a lot. After doing some inspection i found that ManifoldCF
> > doesn't cache User Token's after 1 min. (
> > http://search-lucene.com/m/YqXPHki0Dv/v=threaded).
> > > > >
> > > > > Can I configure these timeout settings value to anything like 60min
> > or 1 day etc ?
> > > > >
> > > > > Regards
> > > > > Anupam
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CONNECTORS-488) The cache settings for all
caching ManifoldCF connectors that cache should be configurable
Posted by "Karl Wright (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karl Wright updated CONNECTORS-488:
-----------------------------------
Fix Version/s: (was: ManifoldCF next)
ManifoldCF 0.7
> The cache settings for all caching ManifoldCF connectors that cache should be configurable
> ------------------------------------------------------------------------------------------
>
> Key: CONNECTORS-488
> URL: https://issues.apache.org/jira/browse/CONNECTORS-488
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Authority Service, Documentum connector, LiveLink connector, Meridio connector
> Affects Versions: ManifoldCF 0.5.1
> Environment: Any Platform
> Reporter: Anupam Bhattacharya
> Assignee: Karl Wright
> Priority: Minor
> Fix For: ManifoldCF 0.7
>
>
> Below is the conversation which helped to resolve the problem. The actual Mail Archive URL is http://mail-archives.apache.org/mod_mbox/manifoldcf-user/201207.mbox/browser.
> -----------------------------------------------------------------------
> Many Thanks!! I changed the value & did rebuild of ManifoldCF which helped
> to solve the issue.
> Regards
> Anupam
> On Tue, Jul 3, 2012 at 4:24 PM, Shinichiro Abe
> <sh...@gmail.com>wrote:
> > Hi,
> >
> > I think you see the following line if you configure cache life time.
> >
> > source:
> > org.apache.manifoldcf.crawler.authorities.DCTM.AuthorityConnector.java
> >
> > protected static long responseLifetime = 60000L; <--this value
> >
> >
> > I think ActiveDirectoryAuthority.java code helps this.
> >
> > Regards,
> > Shinichiro Abe
> >
> > On 2012/07/03, at 19:44, Anupam Bhattacharya wrote:
> >
> > > Sorry i didn't mention that clearly.
> > >
> > > I was just trying to figure out from the SVN Code where the 1 min
> > timeout changes have been kept.
> > > By my best guess, I can see a line which must be doing this 1 min
> > timeout changes in
> > http://svn.apache.org/repos/asf/manifoldcf/trunk/framework/pull-agent/src/main/java/org/apache/manifoldcf/crawler/system/ExpireStufferThread.java
> > >
> > > // If there are no documents at all, then we can sleep for a while.
> > > // The theory is that we need to allow stuff to
> > accumulate.
> > > if (descs.length == 0)
> > > {
> > > ManifoldCF.sleep(60000L); // 1 minute
> > > continue;
> > > }
> > >
> > > Pls. confirm if i am on the right direction.
> > >
> > > Thanks
> > > Anupam
> > >
> > > On Tue, Jul 3, 2012 at 3:51 PM, Shinichiro Abe <
> > shinichiro.abe.1@gmail.com> wrote:
> > > Hi,
> > > Oh sorry, I told about Active Directory Authority Services.
> > > Now there is not a place to configure cache life time
> > > in Documentum Authority Services.
> > >
> > > Shinichiro Abe
> > > On 2012/07/03, at 19:07, Anupam Bhattacharya wrote:
> > >
> > > > Hi,
> > > >
> > > > I am using ManifoldCF for Documentum Repository & Documentum Authority
> > Services. How can I configure cache life time settings in this case when
> > Active directory is not present ?
> > > >
> > > > Regards
> > > > Anupam
> > > >
> > > > On Tue, Jul 3, 2012 at 3:32 PM, Shinichiro Abe <
> > shinichiro.abe.1@gmail.com> wrote:
> > > > Hi,
> > > >
> > > > > Can I configure these timeout settings value to anything like 60min
> > or 1 day etc ?
> > > > Yes, you can configure cache life time,
> > > > in which tokens are cached after last access(user's last access) to
> > the Active Directory.
> > > > I think this value might as well be set to about 60min, 1day is too
> > long.
> > > >
> > > > Regards,
> > > > Shinichiro Abe
> > > >
> > > > On 2012/07/03, at 18:15, Anupam Bhattacharya wrote:
> > > >
> > > > > Hello Karl,
> > > > >
> > > > > First of all congratulations for ManifoldCF graduation to Apache
> > Projects & thanks for all the help you provided during my development
> > previously through this forum.
> > > > >
> > > > > I have recently come across a Performance problem due to ManifoldCF
> > Authority service. After including authority service the Query Response
> > times increases a lot. After doing some inspection i found that ManifoldCF
> > doesn't cache User Token's after 1 min. (
> > http://search-lucene.com/m/YqXPHki0Dv/v=threaded).
> > > > >
> > > > > Can I configure these timeout settings value to anything like 60min
> > or 1 day etc ?
> > > > >
> > > > > Regards
> > > > > Anupam
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CONNECTORS-488) The cache settings for all
caching ManifoldCF connectors that cache should be configurable
Posted by "Karl Wright (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CONNECTORS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karl Wright resolved CONNECTORS-488.
------------------------------------
Resolution: Fixed
r1364205
> The cache settings for all caching ManifoldCF connectors that cache should be configurable
> ------------------------------------------------------------------------------------------
>
> Key: CONNECTORS-488
> URL: https://issues.apache.org/jira/browse/CONNECTORS-488
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Authority Service, Documentum connector, LiveLink connector, Meridio connector
> Affects Versions: ManifoldCF 0.5.1
> Environment: Any Platform
> Reporter: Anupam Bhattacharya
> Assignee: Karl Wright
> Priority: Minor
> Fix For: ManifoldCF 0.7
>
>
> Below is the conversation which helped to resolve the problem. The actual Mail Archive URL is http://mail-archives.apache.org/mod_mbox/manifoldcf-user/201207.mbox/browser.
> -----------------------------------------------------------------------
> Many Thanks!! I changed the value & did rebuild of ManifoldCF which helped
> to solve the issue.
> Regards
> Anupam
> On Tue, Jul 3, 2012 at 4:24 PM, Shinichiro Abe
> <sh...@gmail.com>wrote:
> > Hi,
> >
> > I think you see the following line if you configure cache life time.
> >
> > source:
> > org.apache.manifoldcf.crawler.authorities.DCTM.AuthorityConnector.java
> >
> > protected static long responseLifetime = 60000L; <--this value
> >
> >
> > I think ActiveDirectoryAuthority.java code helps this.
> >
> > Regards,
> > Shinichiro Abe
> >
> > On 2012/07/03, at 19:44, Anupam Bhattacharya wrote:
> >
> > > Sorry i didn't mention that clearly.
> > >
> > > I was just trying to figure out from the SVN Code where the 1 min
> > timeout changes have been kept.
> > > By my best guess, I can see a line which must be doing this 1 min
> > timeout changes in
> > http://svn.apache.org/repos/asf/manifoldcf/trunk/framework/pull-agent/src/main/java/org/apache/manifoldcf/crawler/system/ExpireStufferThread.java
> > >
> > > // If there are no documents at all, then we can sleep for a while.
> > > // The theory is that we need to allow stuff to
> > accumulate.
> > > if (descs.length == 0)
> > > {
> > > ManifoldCF.sleep(60000L); // 1 minute
> > > continue;
> > > }
> > >
> > > Pls. confirm if i am on the right direction.
> > >
> > > Thanks
> > > Anupam
> > >
> > > On Tue, Jul 3, 2012 at 3:51 PM, Shinichiro Abe <
> > shinichiro.abe.1@gmail.com> wrote:
> > > Hi,
> > > Oh sorry, I told about Active Directory Authority Services.
> > > Now there is not a place to configure cache life time
> > > in Documentum Authority Services.
> > >
> > > Shinichiro Abe
> > > On 2012/07/03, at 19:07, Anupam Bhattacharya wrote:
> > >
> > > > Hi,
> > > >
> > > > I am using ManifoldCF for Documentum Repository & Documentum Authority
> > Services. How can I configure cache life time settings in this case when
> > Active directory is not present ?
> > > >
> > > > Regards
> > > > Anupam
> > > >
> > > > On Tue, Jul 3, 2012 at 3:32 PM, Shinichiro Abe <
> > shinichiro.abe.1@gmail.com> wrote:
> > > > Hi,
> > > >
> > > > > Can I configure these timeout settings value to anything like 60min
> > or 1 day etc ?
> > > > Yes, you can configure cache life time,
> > > > in which tokens are cached after last access(user's last access) to
> > the Active Directory.
> > > > I think this value might as well be set to about 60min, 1day is too
> > long.
> > > >
> > > > Regards,
> > > > Shinichiro Abe
> > > >
> > > > On 2012/07/03, at 18:15, Anupam Bhattacharya wrote:
> > > >
> > > > > Hello Karl,
> > > > >
> > > > > First of all congratulations for ManifoldCF graduation to Apache
> > Projects & thanks for all the help you provided during my development
> > previously through this forum.
> > > > >
> > > > > I have recently come across a Performance problem due to ManifoldCF
> > Authority service. After including authority service the Query Response
> > times increases a lot. After doing some inspection i found that ManifoldCF
> > doesn't cache User Token's after 1 min. (
> > http://search-lucene.com/m/YqXPHki0Dv/v=threaded).
> > > > >
> > > > > Can I configure these timeout settings value to anything like 60min
> > or 1 day etc ?
> > > > >
> > > > > Regards
> > > > > Anupam
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira