You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@manifoldcf.apache.org by kw...@apache.org on 2012/06/02 22:37:11 UTC
svn commit: r1345569 [30/36] - in /incubator/lcf/site/publish: ./
release/trunk/ release/trunk/api/activedirectory/
release/trunk/api/activedirectory/org/apache/manifoldcf/authorities/authorities/activedirectory/
release/trunk/api/alfresco/ release/tru...
Modified: incubator/lcf/site/publish/release/trunk/api/rss/index-all.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/index-all.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/index-all.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/index-all.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:37 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
Index
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="./stylesheet.css" TITLE="Style">
@@ -203,7 +203,7 @@ Method in class org.apache.manifoldcf.cr
<DL>
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/Robots.html#cache"><B>cache</B></A> -
Variable in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/Robots.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">Robots</A>
-<DD>This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the
+<DD>This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the
value.
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#cache"><B>cache</B></A> -
Static variable in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">RSSConnector</A>
@@ -309,7 +309,7 @@ Variable in class org.apache.manifoldcf.
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.html" title="class in org.apache.manifoldcf.crawler.connectors.rss"><B>DataCache</B></A> - Class in <A HREF="./org/apache/manifoldcf/crawler/connectors/rss/package-summary.html">org.apache.manifoldcf.crawler.connectors.rss</A><DD>This class is a cache of a specific URL's data.<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.html#DataCache()"><B>DataCache()</B></A> -
Constructor for class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">DataCache</A>
<DD>Constructor.
-<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html" title="class in org.apache.manifoldcf.crawler.connectors.rss"><B>DataCache.DocumentData</B></A> - Class in <A HREF="./org/apache/manifoldcf/crawler/connectors/rss/package-summary.html">org.apache.manifoldcf.crawler.connectors.rss</A><DD>This class represents everything we need to know about a document that's getting passed from the
+<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html" title="class in org.apache.manifoldcf.crawler.connectors.rss"><B>DataCache.DocumentData</B></A> - Class in <A HREF="./org/apache/manifoldcf/crawler/connectors/rss/package-summary.html">org.apache.manifoldcf.crawler.connectors.rss</A><DD>This class represents everything we need to know about a document that's getting passed from the
getDocumentVersions() phase to the processDocuments() phase.<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html#DataCache.DocumentData(java.io.File, java.lang.String)"><B>DataCache.DocumentData(File, String)</B></A> -
Constructor for class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">DataCache.DocumentData</A>
<DD>Constructor.
@@ -651,7 +651,7 @@ Method in class org.apache.manifoldcf.cr
<DD>Get the feed timeout value
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#getFetcher()"><B>getFetcher()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">RSSConnector</A>
-<DD>Given the current parameters, find the correct throttled fetcher object
+<DD>Given the current parameters, find the correct throttled fetcher object
(or create one if not there).
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorToken.html#getGroupNumber()"><B>getGroupNumber()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorToken.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">RSSConnector.EvaluatorToken</A>
@@ -706,7 +706,7 @@ Method in class org.apache.manifoldcf.cr
<DD>Get a specified response header, if it exists.
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#getRobots(org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher)"><B>getRobots(ThrottledFetcher)</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">RSSConnector</A>
-<DD>Given the current parameters, find the correct robots object (or create
+<DD>Given the current parameters, find the correct robots object (or create
one if none found).
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/WebURL.html#getScheme()"><B>getScheme()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/WebURL.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">WebURL</A>
@@ -975,7 +975,7 @@ Method in class org.apache.manifoldcf.cr
<DD>Note that there is a repository connection that is using this object.
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/Robots.html#noteConnectionReleased()"><B>noteConnectionReleased()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/Robots.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">Robots</A>
-<DD>Note that a connection has been released, and free resources if no reason
+<DD>Note that a connection has been released, and free resources if no reason
to retain them.
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html#noteConnectionReleased()"><B>noteConnectionReleased()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher</A>
@@ -1037,7 +1037,7 @@ Method in class org.apache.manifoldcf.cr
<DD>Clean idle stuff out of cache
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#poll()"><B>poll()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">RSSConnector</A>
-<DD>This method is periodically called for all connectors that are connected but not
+<DD>This method is periodically called for all connectors that are connected but not
in active use.
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html#poll()"><B>poll()</B></A> -
Method in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher</A>
@@ -1351,7 +1351,7 @@ Variable in class org.apache.manifoldcf.
<DD>The server object we use to track throttling
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html#serverMap"><B>serverMap</B></A> -
Variable in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher</A>
-<DD>This hash maps the server string (without port) to a server object, where
+<DD>This hash maps the server string (without port) to a server object, where
we can track the statistics and make sure we throttle appropriately
<DT><A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.Server.html#serverName"><B>serverName</B></A> -
Variable in class org.apache.manifoldcf.crawler.connectors.rss.<A HREF="./org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.Server.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher.Server</A>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/index.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/index.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/index.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/index.html Sat Jun 2 20:35:59 2012
@@ -2,7 +2,7 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc on Thu May 31 04:27:37 EDT 2012-->
+<!-- Generated by javadoc on Sat Jun 02 16:09:12 EDT 2012-->
<TITLE>
Generated Documentation (Untitled)
</TITLE>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
DataCache.DocumentData
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -102,7 +102,7 @@ java.lang.Object
</PRE>
<P>
-This class represents everything we need to know about a document that's getting passed from the
+This class represents everything we need to know about a document that's getting passed from the
getDocumentVersions() phase to the processDocuments() phase.
<P>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/DataCache.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:35 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
DataCache
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -99,8 +99,8 @@ java.lang.Object
</PRE>
<P>
-This class is a cache of a specific URL's data. It's fetched early and kept,
- so that (1) an accurate data length can be found, and (2) we can compute a version
+This class is a cache of a specific URL's data. It's fetched early and kept,
+ so that (1) an accurate data length can be found, and (2) we can compute a version
checksum.
<P>
@@ -122,7 +122,7 @@ This class is a cache of a specific URL'
<TD><CODE><B><A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/DataCache.DocumentData.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">DataCache.DocumentData</A></B></CODE>
<BR>
- This class represents everything we need to know about a document that's getting passed from the
+ This class represents everything we need to know about a document that's getting passed from the
getDocumentVersions() phase to the processDocuments() phase.</TD>
</TR>
</TABLE>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/GetSeedList.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/GetSeedList.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/GetSeedList.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/GetSeedList.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
GetSeedList
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/IThrottledConnection.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/IThrottledConnection.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/IThrottledConnection.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/IThrottledConnection.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
IThrottledConnection
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -428,7 +428,7 @@ void <B>beginFetch</B>(java.lang.String&
<DD>Begin the fetch process.
<P>
<DD><DL>
-<DT><B>Parameters:</B><DD><CODE>fetchType</CODE> - is a short descriptive string describing the kind of fetch being requested. This
+<DT><B>Parameters:</B><DD><CODE>fetchType</CODE> - is a short descriptive string describing the kind of fetch being requested. This
is used solely for logging purposes.
<DT><B>Throws:</B>
<DD><CODE>org.apache.manifoldcf.core.interfaces.ManifoldCFException</CODE></DL>
@@ -454,11 +454,11 @@ int <B>executeFetch</B>(java.lang.String
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
org.apache.manifoldcf.agents.interfaces.ServiceInterruption</PRE>
<DL>
-<DD>Execute the fetch and get the return code. This method uses the
- standard logging mechanism to keep track of the fetch attempt. It also
- signals the following three conditions: ServiceInterruption (if a dynamic
- error occurs), OK, or a static error code (for a condition where retry is
- not likely to be helpful). The actual HTTP error code is NOT returned by
+<DD>Execute the fetch and get the return code. This method uses the
+ standard logging mechanism to keep track of the fetch attempt. It also
+ signals the following three conditions: ServiceInterruption (if a dynamic
+ error occurs), OK, or a static error code (for a condition where retry is
+ not likely to be helpful). The actual HTTP error code is NOT returned by
this method.
<P>
<DD><DL>
@@ -497,7 +497,7 @@ java.io.InputStream <B>getResponseBodySt
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
org.apache.manifoldcf.agents.interfaces.ServiceInterruption</PRE>
<DL>
-<DD>Get the response input stream. It is the responsibility of the caller
+<DD>Get the response input stream. It is the responsibility of the caller
to close this stream when done.
<P>
<DD><DL>
@@ -534,7 +534,7 @@ doneFetch</H3>
void <B>doneFetch</B>(org.apache.manifoldcf.crawler.interfaces.IVersionActivity activities)
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Done with the fetch. Call this when the fetch has been completed. A log entry will be generated
+<DD>Done with the fetch. Call this when the fetch has been completed. A log entry will be generated
describing what was done.
<P>
<DD><DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Messages.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Messages.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Messages.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Messages.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
Messages
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicies.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicies.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicies.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicies.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.CanonicalizationPolicies
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicy.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicy.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicy.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.CanonicalizationPolicy.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.CanonicalizationPolicy
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorToken.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorToken.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorToken.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorToken.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.EvaluatorToken
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorTokenStream.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorTokenStream.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorTokenStream.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.EvaluatorTokenStream.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.EvaluatorTokenStream
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.FeedContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedItemContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedItemContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedItemContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.FeedItemContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.FeedItemContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.Filter.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.Filter.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.Filter.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.Filter.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.Filter
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -102,8 +102,8 @@ java.lang.Object
</PRE>
<P>
-Class that handles parsing and interpretation of the document specification.
- Note that I believe it to be faster to do this once, gathering all the data, than to scan the document specification multiple times.
+Class that handles parsing and interpretation of the document specification.
+ Note that I believe it to be faster to do this once, gathering all the data, than to scan the document specification multiple times.
Therefore, this class contains the *entire* interpreted set of data from a document specification.
<P>
@@ -644,7 +644,7 @@ public boolean <B>isLegalURL</B>(java.la
<P>
<DD><DL>
-<DT><B>Returns:</B><DD>true if the passed-in url is either a seed, or a legal url, according to this
+<DT><B>Returns:</B><DD>true if the passed-in url is either a seed, or a legal url, according to this
filter.</DL>
</DD>
</DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRule.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRule.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRule.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRule.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.MappingRule
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRules.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRules.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRules.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.MappingRules.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.MappingRules
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.NameValue.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.NameValue.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.NameValue.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.NameValue.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector.NameValue
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.OuterContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.OuterContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.OuterContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.OuterContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.OuterContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.RDFContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFItemContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFItemContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFItemContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RDFItemContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.RDFItemContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSChannelContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSChannelContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSChannelContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSChannelContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.RSSChannelContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.RSSContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSItemContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSItemContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSItemContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.RSSItemContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.RSSItemContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.UrlsetContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetItemContextClass.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetItemContextClass.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetItemContextClass.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.UrlsetItemContextClass.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
RSSConnector.UrlsetItemContextClass
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
RSSConnector
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -104,12 +104,12 @@ java.lang.Object
</PRE>
<P>
-This is the RSS implementation of the IRepositoryConnector interface.
- This connector basically looks at an RSS document in order to seed the
- document queue. The document is always fetched from the same URL (it's
- specified in the configuration parameters). The documents subsequently
- crawled are not scraped for additional links; only the primary document is
- ingested. On the other hand, redirections ARE honored, so that various
+This is the RSS implementation of the IRepositoryConnector interface.
+ This connector basically looks at an RSS document in order to seed the
+ document queue. The document is always fetched from the same URL (it's
+ specified in the configuration parameters). The documents subsequently
+ crawled are not scraped for additional links; only the primary document is
+ ingested. On the other hand, redirections ARE honored, so that various
sites that use this trick can be supported (e.g. the BBC)
<P>
@@ -753,7 +753,7 @@ This is the RSS implementation of the IR
<TD><CODE><B><A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#getFetcher()">getFetcher</A></B>()</CODE>
<BR>
- Given the current parameters, find the correct throttled fetcher object
+ Given the current parameters, find the correct throttled fetcher object
(or create one if not there).</TD>
</TR>
<TR BGCOLOR="white" CLASS="TableRowColor">
@@ -770,7 +770,7 @@ This is the RSS implementation of the IR
<TD><CODE><B><A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#getRobots(org.apache.manifoldcf.crawler.connectors.rss.ThrottledFetcher)">getRobots</A></B>(<A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher</A> fetcher)</CODE>
<BR>
- Given the current parameters, find the correct robots object (or create
+ Given the current parameters, find the correct robots object (or create
one if none found).</TD>
</TR>
<TR BGCOLOR="white" CLASS="TableRowColor">
@@ -895,7 +895,7 @@ This is the RSS implementation of the IR
<TD><CODE><B><A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/RSSConnector.html#poll()">poll</A></B>()</CODE>
<BR>
- This method is periodically called for all connectors that are connected but not
+ This method is periodically called for all connectors that are connected but not
in active use.</TD>
</TR>
<TR BGCOLOR="white" CLASS="TableRowColor">
@@ -1576,7 +1576,7 @@ getConnectorModel</H3>
<PRE>
public int <B>getConnectorModel</B>()</PRE>
<DL>
-<DD>Tell the world what model this connector uses for getDocumentIdentifiers().
+<DD>Tell the world what model this connector uses for getDocumentIdentifiers().
This must return a model value as specified above.
<P>
<DD><DL>
@@ -1600,7 +1600,7 @@ public void <B>connect</B>(org.apache.ma
<DT><B>Specified by:</B><DD><CODE>connect</CODE> in interface <CODE>org.apache.manifoldcf.core.interfaces.IConnector</CODE><DT><B>Overrides:</B><DD><CODE>connect</CODE> in class <CODE>org.apache.manifoldcf.core.connector.BaseConnector</CODE></DL>
</DD>
<DD><DL>
-<DT><B>Parameters:</B><DD><CODE>configParams</CODE> - are the configuration parameters for this connection.
+<DT><B>Parameters:</B><DD><CODE>configParams</CODE> - are the configuration parameters for this connection.
Note well: There are no exceptions allowed from this call, since it is expected to mainly establish connection parameters.</DL>
</DD>
</DL>
@@ -1612,7 +1612,7 @@ poll</H3>
public void <B>poll</B>()
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>This method is periodically called for all connectors that are connected but not
+<DD>This method is periodically called for all connectors that are connected but not
in active use.
<P>
<DD><DL>
@@ -1669,11 +1669,11 @@ getBinNames</H3>
<PRE>
public java.lang.String[] <B>getBinNames</B>(java.lang.String documentIdentifier)</PRE>
<DL>
-<DD>Get the bin name string for a document identifier. The bin name describes the queue to which the
- document will be assigned for throttling purposes. Throttling controls the rate at which items in a
- given queue are fetched; it does not say anything about the overall fetch rate, which may operate on
- multiple queues or bins.
- For example, if you implement a web crawler, a good choice of bin name would be the server name, since
+<DD>Get the bin name string for a document identifier. The bin name describes the queue to which the
+ document will be assigned for throttling purposes. Throttling controls the rate at which items in a
+ given queue are fetched; it does not say anything about the overall fetch rate, which may operate on
+ multiple queues or bins.
+ For example, if you implement a web crawler, a good choice of bin name would be the server name, since
that is likely to correspond to a real resource that will need real throttle protection.
<P>
<DD><DL>
@@ -1696,25 +1696,25 @@ public void <B>addSeedDocuments</B>(org.
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
org.apache.manifoldcf.agents.interfaces.ServiceInterruption</PRE>
<DL>
-<DD>Queue "seed" documents. Seed documents are the starting places for crawling activity. Documents
- are seeded when this method calls appropriate methods in the passed in ISeedingActivity object.
-
- This method can choose to find repository changes that happen only during the specified time interval.
- The seeds recorded by this method will be viewed by the framework based on what the
- getConnectorModel() method returns.
-
- It is not a big problem if the connector chooses to create more seeds than are
- strictly necessary; it is merely a question of overall work required.
-
- The times passed to this method may be interpreted for greatest efficiency. The time ranges
- any given job uses with this connector will not overlap, but will proceed starting at 0 and going
- to the "current time", each time the job is run. For continuous crawling jobs, this method will
- be called once, when the job starts, and at various periodic intervals as the job executes.
-
- When a job's specification is changed, the framework automatically resets the seeding start time to 0. The
- seeding start time may also be set to 0 on each job run, depending on the connector model returned by
- getConnectorModel().
-
+<DD>Queue "seed" documents. Seed documents are the starting places for crawling activity. Documents
+ are seeded when this method calls appropriate methods in the passed in ISeedingActivity object.
+
+ This method can choose to find repository changes that happen only during the specified time interval.
+ The seeds recorded by this method will be viewed by the framework based on what the
+ getConnectorModel() method returns.
+
+ It is not a big problem if the connector chooses to create more seeds than are
+ strictly necessary; it is merely a question of overall work required.
+
+ The times passed to this method may be interpreted for greatest efficiency. The time ranges
+ any given job uses with this connector will not overlap, but will proceed starting at 0 and going
+ to the "current time", each time the job is run. For continuous crawling jobs, this method will
+ be called once, when the job starts, and at various periodic intervals as the job executes.
+
+ When a job's specification is changed, the framework automatically resets the seeding start time to 0. The
+ seeding start time may also be set to 0 on each job run, depending on the connector model returned by
+ getConnectorModel().
+
Note that it is always ok to send MORE documents rather than less to this method.
<P>
<DD><DL>
@@ -1737,10 +1737,10 @@ protected static java.lang.String <B>mak
java.lang.String rawURL)
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Convert an absolute or relative URL to a document identifier. This may involve several steps at some point,
- but right now it does NOT involve converting the host name to a canonical host name.
- (Doing so would destroy the ability of virtually hosted sites to do the right thing,
- since the original host name would be lost.) Thus, we do the conversion to IP address
+<DD>Convert an absolute or relative URL to a document identifier. This may involve several steps at some point,
+ but right now it does NOT involve converting the host name to a canonical host name.
+ (Doing so would destroy the ability of virtually hosted sites to do the right thing,
+ since the original host name would be lost.) Thus, we do the conversion to IP address
right before we actually fetch the document.
<P>
<DD><DL>
@@ -1783,21 +1783,21 @@ public java.lang.String[] <B>getDocument
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
org.apache.manifoldcf.agents.interfaces.ServiceInterruption</PRE>
<DL>
-<DD>Get document versions given an array of document identifiers.
- This method is called for EVERY document that is considered. It is
+<DD>Get document versions given an array of document identifiers.
+ This method is called for EVERY document that is considered. It is
therefore important to perform as little work as possible here.
<P>
<DD><DL>
<DT><B>Specified by:</B><DD><CODE>getDocumentVersions</CODE> in interface <CODE>org.apache.manifoldcf.crawler.interfaces.IRepositoryConnector</CODE><DT><B>Overrides:</B><DD><CODE>getDocumentVersions</CODE> in class <CODE>org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector</CODE></DL>
</DD>
<DD><DL>
-<DT><B>Parameters:</B><DD><CODE>documentIdentifiers</CODE> - is the array of local document identifiers, as understood by this connector.<DD><CODE>oldVersions</CODE> - is the corresponding array of version strings that have been saved for the document identifiers.
- A null value indicates that this is a first-time fetch, while an empty string indicates that the previous document
- had an empty version string.<DD><CODE>activities</CODE> - is the interface this method should use to perform whatever framework actions are desired.<DD><CODE>spec</CODE> - is the current document specification for the current job. If there is a dependency on this
- specification, then the version string should include the pertinent data, so that reingestion will occur
+<DT><B>Parameters:</B><DD><CODE>documentIdentifiers</CODE> - is the array of local document identifiers, as understood by this connector.<DD><CODE>oldVersions</CODE> - is the corresponding array of version strings that have been saved for the document identifiers.
+ A null value indicates that this is a first-time fetch, while an empty string indicates that the previous document
+ had an empty version string.<DD><CODE>activities</CODE> - is the interface this method should use to perform whatever framework actions are desired.<DD><CODE>spec</CODE> - is the current document specification for the current job. If there is a dependency on this
+ specification, then the version string should include the pertinent data, so that reingestion will occur
when the specification changes. This is primarily useful for metadata.<DD><CODE>jobType</CODE> - is an integer describing how the job is being run, whether continuous or once-only.<DD><CODE>usesDefaultAuthority</CODE> - will be true only if the authority in use for these documents is the default one.
-<DT><B>Returns:</B><DD>the corresponding version strings, with null in the places where the document no longer exists.
- Empty version strings indicate that there is no versioning ability for the corresponding document, and the document
+<DT><B>Returns:</B><DD>the corresponding version strings, with null in the places where the document no longer exists.
+ Empty version strings indicate that there is no versioning ability for the corresponding document, and the document
will always be processed.
<DT><B>Throws:</B>
<DD><CODE>org.apache.manifoldcf.core.interfaces.ManifoldCFException</CODE>
@@ -1818,17 +1818,17 @@ public void <B>processDocuments</B>(java
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
org.apache.manifoldcf.agents.interfaces.ServiceInterruption</PRE>
<DL>
-<DD>Process a set of documents.
- This is the method that should cause each document to be fetched, processed, and the results either added
- to the queue of documents for the current job, and/or entered into the incremental ingestion manager.
+<DD>Process a set of documents.
+ This is the method that should cause each document to be fetched, processed, and the results either added
+ to the queue of documents for the current job, and/or entered into the incremental ingestion manager.
The document specification allows this class to filter what is done based on the job.
<P>
<DD><DL>
<DT><B>Specified by:</B><DD><CODE>processDocuments</CODE> in interface <CODE>org.apache.manifoldcf.crawler.interfaces.IRepositoryConnector</CODE><DT><B>Overrides:</B><DD><CODE>processDocuments</CODE> in class <CODE>org.apache.manifoldcf.crawler.connectors.BaseRepositoryConnector</CODE></DL>
</DD>
<DD><DL>
-<DT><B>Parameters:</B><DD><CODE>documentIdentifiers</CODE> - is the set of document identifiers to process.<DD><CODE>activities</CODE> - is the interface this method should use to queue up new document references
- and ingest documents.<DD><CODE>spec</CODE> - is the document specification.<DD><CODE>scanOnly</CODE> - is an array corresponding to the document identifiers. It is set to true to indicate when the processing
+<DT><B>Parameters:</B><DD><CODE>documentIdentifiers</CODE> - is the set of document identifiers to process.<DD><CODE>activities</CODE> - is the interface this method should use to queue up new document references
+ and ingest documents.<DD><CODE>spec</CODE> - is the document specification.<DD><CODE>scanOnly</CODE> - is an array corresponding to the document identifiers. It is set to true to indicate when the processing
should only find other references, and should not actually call the ingestion methods.
<DT><B>Throws:</B>
<DD><CODE>org.apache.manifoldcf.core.interfaces.ManifoldCFException</CODE>
@@ -1844,9 +1844,9 @@ public void <B>releaseDocumentVersions</
java.lang.String[] versions)
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Free a set of documents. This method is called for all documents whose versions have been fetched using
- the getDocumentVersions() method, including those that returned null versions. It may be used to free resources
- committed during the getDocumentVersions() method. It is guaranteed to be called AFTER any calls to
+<DD>Free a set of documents. This method is called for all documents whose versions have been fetched using
+ the getDocumentVersions() method, including those that returned null versions. It may be used to free resources
+ committed during the getDocumentVersions() method. It is guaranteed to be called AFTER any calls to
processDocuments() for the documents in question.
<P>
<DD><DL>
@@ -1871,8 +1871,8 @@ public void <B>outputConfigurationHeader
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
java.io.IOException</PRE>
<DL>
-<DD>Output the configuration header section.
- This method is called in the head section of the connector's configuration page. Its purpose is to add the required tabs to the list, and to output any
+<DD>Output the configuration header section.
+ This method is called in the head section of the connector's configuration page. Its purpose is to add the required tabs to the list, and to output any
javascript methods that might be needed by the configuration editing HTML.
<P>
<DD><DL>
@@ -1898,9 +1898,9 @@ public void <B>outputConfigurationBody</
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
java.io.IOException</PRE>
<DL>
-<DD>Output the configuration body section.
- This method is called in the body section of the connector's configuration page. Its purpose is to present the required form elements for editing.
- The coder can presume that the HTML that is output from this configuration will be within appropriate <html>, <body>, and <form> tags. The name of the
+<DD>Output the configuration body section.
+ This method is called in the body section of the connector's configuration page. Its purpose is to present the required form elements for editing.
+ The coder can presume that the HTML that is output from this configuration will be within appropriate <html>, <body>, and <form> tags. The name of the
form is "editconnection".
<P>
<DD><DL>
@@ -1924,9 +1924,9 @@ public java.lang.String <B>processConfig
org.apache.manifoldcf.core.interfaces.ConfigParams parameters)
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Process a configuration post.
- This method is called at the start of the connector's configuration page, whenever there is a possibility that form data for a connection has been
- posted. Its purpose is to gather form information and modify the configuration parameters accordingly.
+<DD>Process a configuration post.
+ This method is called at the start of the connector's configuration page, whenever there is a possibility that form data for a connection has been
+ posted. Its purpose is to gather form information and modify the configuration parameters accordingly.
The name of the posted form is "editconnection".
<P>
<DD><DL>
@@ -1951,8 +1951,8 @@ public void <B>viewConfiguration</B>(org
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
java.io.IOException</PRE>
<DL>
-<DD>View configuration.
- This method is called in the body section of the connector's view configuration page. Its purpose is to present the connection information to the user.
+<DD>View configuration.
+ This method is called in the body section of the connector's view configuration page. Its purpose is to present the connection information to the user.
The coder can presume that the HTML that is output from this configuration will be within appropriate <html> and <body> tags.
<P>
<DD><DL>
@@ -1977,8 +1977,8 @@ public void <B>outputSpecificationHeader
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
java.io.IOException</PRE>
<DL>
-<DD>Output the specification header section.
- This method is called in the head section of a job page which has selected a repository connection of the current type. Its purpose is to add the required tabs
+<DD>Output the specification header section.
+ This method is called in the head section of a job page which has selected a repository connection of the current type. Its purpose is to add the required tabs
to the list, and to output any javascript methods that might be needed by the job editing HTML.
<P>
<DD><DL>
@@ -2003,9 +2003,9 @@ public void <B>outputSpecificationBody</
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
java.io.IOException</PRE>
<DL>
-<DD>Output the specification body section.
- This method is called in the body section of a job page which has selected a repository connection of the current type. Its purpose is to present the required form elements for editing.
- The coder can presume that the HTML that is output from this configuration will be within appropriate <html>, <body>, and <form> tags. The name of the
+<DD>Output the specification body section.
+ This method is called in the body section of a job page which has selected a repository connection of the current type. Its purpose is to present the required form elements for editing.
+ The coder can presume that the HTML that is output from this configuration will be within appropriate <html>, <body>, and <form> tags. The name of the
form is "editjob".
<P>
<DD><DL>
@@ -2028,9 +2028,9 @@ public java.lang.String <B>processSpecif
org.apache.manifoldcf.crawler.interfaces.DocumentSpecification ds)
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Process a specification post.
- This method is called at the start of job's edit or view page, whenever there is a possibility that form data for a connection has been
- posted. Its purpose is to gather form information and modify the document specification accordingly.
+<DD>Process a specification post.
+ This method is called at the start of job's edit or view page, whenever there is a possibility that form data for a connection has been
+ posted. Its purpose is to gather form information and modify the document specification accordingly.
The name of the posted form is "editjob".
<P>
<DD><DL>
@@ -2054,8 +2054,8 @@ public void <B>viewSpecification</B>(org
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
java.io.IOException</PRE>
<DL>
-<DD>View specification.
- This method is called in the body section of a job's view page. Its purpose is to present the document specification information to the user.
+<DD>View specification.
+ This method is called in the body section of a job's view page. Its purpose is to present the document specification information to the user.
The coder can presume that the HTML that is output from this configuration will be within appropriate <html> and <body> tags.
<P>
<DD><DL>
@@ -2189,7 +2189,7 @@ getFetcher</H3>
<PRE>
protected <A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher</A> <B>getFetcher</B>()</PRE>
<DL>
-<DD>Given the current parameters, find the correct throttled fetcher object
+<DD>Given the current parameters, find the correct throttled fetcher object
(or create one if not there).
<P>
<DD><DL>
@@ -2203,7 +2203,7 @@ getRobots</H3>
<PRE>
protected <A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/Robots.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">Robots</A> <B>getRobots</B>(<A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.html" title="class in org.apache.manifoldcf.crawler.connectors.rss">ThrottledFetcher</A> fetcher)</PRE>
<DL>
-<DD>Given the current parameters, find the correct robots object (or create
+<DD>Given the current parameters, find the correct robots object (or create
one if none found).
<P>
<DD><DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Host.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Host.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Host.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Host.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
Robots.Host
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -102,7 +102,7 @@ java.lang.Object
</PRE>
<P>
-This class maintains status for a given host. There's an instance of this class for
+This class maintains status for a given host. There's an instance of this class for
each host in the robots cache.
<P>
@@ -456,8 +456,8 @@ canBeFlushed</H3>
<PRE>
public boolean <B>canBeFlushed</B>(long currentTime)</PRE>
<DL>
-<DD>Check if the current record can be flushed.
- This is not quite the same as whether the record is valid, since a not-yet-valid record still should not be flushed when there
+<DD>Check if the current record can be flushed.
+ This is not quite the same as whether the record is valid, since a not-yet-valid record still should not be flushed when there
is activity going on with that record!
<P>
<DD><DL>
@@ -486,7 +486,7 @@ protected void <B>makeValid</B>(long&nbs
throws org.apache.manifoldcf.agents.interfaces.ServiceInterruption,
org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Initialize the record. This method reads the robots file on the specified protocol/host/port,
+<DD>Initialize the record. This method reads the robots file on the specified protocol/host/port,
and parses it according to the rules.
<P>
<DD><DL>
@@ -507,7 +507,7 @@ protected void <B>parseRobotsTxt</B>(jav
throws java.io.IOException,
org.apache.manifoldcf.core.interfaces.ManifoldCFException</PRE>
<DL>
-<DD>Parse the robots.txt file using a reader.
+<DD>Parse the robots.txt file using a reader.
Is NOT expected to close the stream.
<P>
<DD><DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Record.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Record.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Record.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.Record.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
Robots.Record
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -102,7 +102,7 @@ java.lang.Object
</PRE>
<P>
-This class represents a record in a robots.txt file. It contains one or
+This class represents a record in a robots.txt file. It contains one or
more user-agents, and one or more disallows.
<P>
@@ -356,8 +356,8 @@ isDisallowed</H3>
<PRE>
public boolean <B>isDisallowed</B>(java.lang.String path)</PRE>
<DL>
-<DD>See if path is disallowed. Only called if user-agent has already
- matched. (This checks if there's an explicit match with one of the
+<DD>See if path is disallowed. Only called if user-agent has already
+ matched. (This checks if there's an explicit match with one of the
Disallows clauses.)
<P>
<DD><DL>
@@ -371,8 +371,8 @@ isAllowed</H3>
<PRE>
public boolean <B>isAllowed</B>(java.lang.String path)</PRE>
<DL>
-<DD>See if path is allowed. Only called if user-agent has already
- matched. (This checks if there's an explicit match with one of the
+<DD>See if path is allowed. Only called if user-agent has already
+ matched. (This checks if there's an explicit match with one of the
Allows clauses).
<P>
<DD><DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/Robots.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:11 EDT 2012 -->
<TITLE>
Robots
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -99,10 +99,10 @@ java.lang.Object
</PRE>
<P>
-This class is a cache of a specific robots data. It is loaded and fetched according to standard
- robots rules; namely, caching for up to 24 hrs, format and parsing rules consistent with
- http://www.robotstxt.org/wc/robots.html. The apache Httpclient is used to fetch the robots files, when necessary.
- An instance of this class should be constructed statically in order for the caching properties to work to
+This class is a cache of a specific robots data. It is loaded and fetched according to standard
+ robots rules; namely, caching for up to 24 hrs, format and parsing rules consistent with
+ http://www.robotstxt.org/wc/robots.html. The apache Httpclient is used to fetch the robots files, when necessary.
+ An instance of this class should be constructed statically in order for the caching properties to work to
maximum advantage.
<P>
@@ -157,7 +157,7 @@ This class is a cache of a specific robo
<TD><CODE><B><A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/Robots.html#cache">cache</A></B></CODE>
<BR>
- This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the
+ This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the
value.</TD>
</TR>
<TR BGCOLOR="white" CLASS="TableRowColor">
@@ -291,7 +291,7 @@ This class is a cache of a specific robo
<TD><CODE><B><A HREF="../../../../../../org/apache/manifoldcf/crawler/connectors/rss/Robots.html#noteConnectionReleased()">noteConnectionReleased</A></B>()</CODE>
<BR>
- Note that a connection has been released, and free resources if no reason
+ Note that a connection has been released, and free resources if no reason
to retain them.</TD>
</TR>
<TR BGCOLOR="white" CLASS="TableRowColor">
@@ -400,7 +400,7 @@ cache</H3>
<PRE>
protected java.util.Map <B>cache</B></PRE>
<DL>
-<DD>This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the
+<DD>This is the cache hash - which is keyed by the protocol/host/port, and has a Host object as the
value.
<P>
<DL>
@@ -454,7 +454,7 @@ noteConnectionReleased</H3>
<PRE>
public void <B>noteConnectionReleased</B>()</PRE>
<DL>
-<DD>Note that a connection has been released, and free resources if no reason
+<DD>Note that a connection has been released, and free resources if no reason
to retain them.
<P>
<DD><DL>
@@ -498,8 +498,8 @@ public boolean <B>isFetchAllowed</B>(jav
throws org.apache.manifoldcf.core.interfaces.ManifoldCFException,
org.apache.manifoldcf.agents.interfaces.ServiceInterruption</PRE>
<DL>
-<DD>Decide whether a specific robot can crawl a specific URL.
- A ServiceInterruption exception is thrown if the fetch itself fails in a transient way.
+<DD>Decide whether a specific robot can crawl a specific URL.
+ A ServiceInterruption exception is thrown if the fetch itself fails in a transient way.
A permanent failure (such as an invalid URL) with throw a ManifoldCFException.
<P>
<DD><DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/SetSeedList.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/SetSeedList.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/SetSeedList.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/SetSeedList.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
SetSeedList
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataRecorder.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataRecorder.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataRecorder.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataRecorder.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
ThrottledFetcher.DataRecorder
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataSession.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataSession.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataSession.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.DataSession.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
ThrottledFetcher.DataSession
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.Server.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.Server.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.Server.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.Server.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
ThrottledFetcher.Server
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">
@@ -102,47 +102,47 @@ java.lang.Object
</PRE>
<P>
-This class represents the throttling stuff kept around for a single server.
-
- In order to calculate
- the effective "burst" fetches per second and bytes per second, we need to have some idea what the window is.
- For example, a long hiatus from fetching could cause overuse of the server when fetching resumes, if the
- window length is too long.
-
- One solution to this problem would be to keep a list of the individual fetches as records. Then, we could
- "expire" a fetch by discarding the old record. However, this is quite memory consumptive for all but the
- smallest intervals.
-
- Another, better, solution is to hook into the start and end of individual fetches. These will, presumably, occur
- at the fastest possible rate without long pauses spent doing something else. The only complication is that
- fetches may well overlap, so we need to "reference count" the fetches to know when to reset the counters.
- For "fetches per second", we can simply make sure we "schedule" the next fetch at an appropriate time, rather
- than keep records around. The overall rate may therefore be somewhat less than the specified rate, but that's perfectly
- acceptable.
-
- For the "maximum open connections" limit, the best thing would be to establish a separate MultiThreadedConnectionPool
- for each Server. Then, the limit would be automatic.
-
- Some notes on the algorithms used to limit server bandwidth impact
- ==================================================================
-
- In a single connection case, the algorithm we'd want to use works like this. On the first chunk of a series,
- the total length of time and the number of bytes are recorded. Then, prior to each subsequent chunk, a calculation
- is done which attempts to hit the bandwidth target by the end of the chunk read, using the rate of the first chunk
- access as a way of estimating how long it will take to fetch those next n bytes.
-
- For a multi-connection case, which this is, it's harder to either come up with a good maximum bandwidth estimate,
- and harder still to "hit the target", because simultaneous fetches will intrude. The strategy is therefore:
-
- 1) The first chunk of any series should proceed without interference from other connections to the same server.
- The goal here is to get a decent quality estimate without any possibility of overwhelming the server.
-
- 2) The bandwidth of the first chunk is treated as the "maximum bandwidth per connection". That is, if other
- connections are going on, we can presume that each connection will use at most the bandwidth that the first fetch
- took. Thus, by generating end-time estimates based on this number, we are actually being conservative and
- using less server bandwidth.
-
- 3) For chunks that have started but not finished, we keep track of their size and estimated elapsed time in order to schedule when
+This class represents the throttling stuff kept around for a single server.
+
+ In order to calculate
+ the effective "burst" fetches per second and bytes per second, we need to have some idea what the window is.
+ For example, a long hiatus from fetching could cause overuse of the server when fetching resumes, if the
+ window length is too long.
+
+ One solution to this problem would be to keep a list of the individual fetches as records. Then, we could
+ "expire" a fetch by discarding the old record. However, this is quite memory consumptive for all but the
+ smallest intervals.
+
+ Another, better, solution is to hook into the start and end of individual fetches. These will, presumably, occur
+ at the fastest possible rate without long pauses spent doing something else. The only complication is that
+ fetches may well overlap, so we need to "reference count" the fetches to know when to reset the counters.
+ For "fetches per second", we can simply make sure we "schedule" the next fetch at an appropriate time, rather
+ than keep records around. The overall rate may therefore be somewhat less than the specified rate, but that's perfectly
+ acceptable.
+
+ For the "maximum open connections" limit, the best thing would be to establish a separate MultiThreadedConnectionPool
+ for each Server. Then, the limit would be automatic.
+
+ Some notes on the algorithms used to limit server bandwidth impact
+ ==================================================================
+
+ In a single connection case, the algorithm we'd want to use works like this. On the first chunk of a series,
+ the total length of time and the number of bytes are recorded. Then, prior to each subsequent chunk, a calculation
+ is done which attempts to hit the bandwidth target by the end of the chunk read, using the rate of the first chunk
+ access as a way of estimating how long it will take to fetch those next n bytes.
+
+ For a multi-connection case, which this is, it's harder to either come up with a good maximum bandwidth estimate,
+ and harder still to "hit the target", because simultaneous fetches will intrude. The strategy is therefore:
+
+ 1) The first chunk of any series should proceed without interference from other connections to the same server.
+ The goal here is to get a decent quality estimate without any possibility of overwhelming the server.
+
+ 2) The bandwidth of the first chunk is treated as the "maximum bandwidth per connection". That is, if other
+ connections are going on, we can presume that each connection will use at most the bandwidth that the first fetch
+ took. Thus, by generating end-time estimates based on this number, we are actually being conservative and
+ using less server bandwidth.
+
+ 3) For chunks that have started but not finished, we keep track of their size and estimated elapsed time in order to schedule when
new chunks from other connections can start.
<P>
@@ -549,7 +549,7 @@ beginFetch</H3>
public void <B>beginFetch</B>(long minimumMillisecondsPerFetchPerServer)
throws java.lang.InterruptedException</PRE>
<DL>
-<DD>Note the start of a fetch operation. Call this method just before the actual stream access begins.
+<DD>Note the start of a fetch operation. Call this method just before the actual stream access begins.
May wait until schedule allows.
<P>
<DD><DL>
@@ -580,7 +580,7 @@ public void <B>beginRead</B>(int by
double minimumMillisecondsPerBytePerServer)
throws java.lang.InterruptedException</PRE>
<DL>
-<DD>Note the start of an individual byte read of a specified size. Call this method just before the
+<DD>Note the start of an individual byte read of a specified size. Call this method just before the
read request takes place. Performs the necessary delay prior to reading specified number of bytes from the server.
<P>
<DD><DL>
@@ -597,7 +597,7 @@ endRead</H3>
public void <B>endRead</B>(int originalCount,
int actualCount)</PRE>
<DL>
-<DD>Note the end of an individual read from the server. Call this just after an individual read completes.
+<DD>Note the end of an individual read from the server. Call this just after an individual read completes.
Pass the actual number of bytes read to the method.
<P>
<DD><DL>
Modified: incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.ThrottledConnection.ExecuteMethodThread.html
URL: http://svn.apache.org/viewvc/incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.ThrottledConnection.ExecuteMethodThread.html?rev=1345569&r1=1345568&r2=1345569&view=diff
==============================================================================
--- incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.ThrottledConnection.ExecuteMethodThread.html (original)
+++ incubator/lcf/site/publish/release/trunk/api/rss/org/apache/manifoldcf/crawler/connectors/rss/ThrottledFetcher.ThrottledConnection.ExecuteMethodThread.html Sat Jun 2 20:35:59 2012
@@ -2,12 +2,12 @@
<!--NewPage-->
<HTML>
<HEAD>
-<!-- Generated by javadoc (build 1.6.0_21) on Thu May 31 04:27:36 EDT 2012 -->
+<!-- Generated by javadoc (build 1.6.0_21) on Sat Jun 02 16:09:12 EDT 2012 -->
<TITLE>
ThrottledFetcher.ThrottledConnection.ExecuteMethodThread
</TITLE>
-<META NAME="date" CONTENT="2012-05-31">
+<META NAME="date" CONTENT="2012-06-02">
<LINK REL ="stylesheet" TYPE="text/css" HREF="../../../../../../stylesheet.css" TITLE="Style">