You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nutch.apache.org by sn...@apache.org on 2025/07/20 18:41:34 UTC
(nutch-site) branch main updated (c011a7e -> c7347eb)
This is an automated email from the ASF dual-hosted git repository.
snagel pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/nutch-site.git
from c011a7e Revert incorrect change (#2)
new 607dc40 Link to RFC 9309 which Nutch (relying on crawler-commons) is following as robots.txt standard since Nutch 1.19
new 5a076b0 Improve formatting of the sitemap.xml
new 0ff1d83 Add dates to the news items listed on the news overview page
new c7347eb Update site for release of Nutch 1.21
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 1 +
config.toml | 2 +-
content/community/bot.md | 4 +-
content/doap.rdf | 7 +
.../javadoc/api/allclasses-index.html | 831 ++++++++++-----------
content/documentation/javadoc/api/allclasses.html | 20 +-
.../javadoc/api/allpackages-index.html | 66 +-
.../documentation/javadoc/api/constant-values.html | 58 +-
.../documentation/javadoc/api/deprecated-list.html | 21 +-
content/documentation/javadoc/api/element-list | 2 -
content/documentation/javadoc/api/help-doc.html | 12 +-
content/documentation/javadoc/api/index-all.html | 254 ++-----
content/documentation/javadoc/api/index.html | 72 +-
.../javadoc/api/jquery/jquery-3.6.1.min.js | 2 -
.../javadoc/api/jquery/jquery-3.7.1.min.js | 2 +
.../javadoc/api/legal/ADDITIONAL_LICENSE_INFO | 37 -
content/documentation/javadoc/api/legal/LICENSE | 347 ---------
content/documentation/javadoc/api/legal/jquery.md | 50 +-
.../javadoc/api/member-search-index.js | 2 +-
.../javadoc/api/member-search-index.zip | Bin 40541 -> 40145 bytes
.../nutch/analysis/lang/HTMLLanguageParser.html | 12 +-
.../analysis/lang/LanguageIndexingFilter.html | 12 +-
.../lang/class-use/HTMLLanguageParser.html | 12 +-
.../lang/class-use/LanguageIndexingFilter.html | 12 +-
.../nutch/analysis/lang/package-summary.html | 12 +-
.../apache/nutch/analysis/lang/package-tree.html | 12 +-
.../apache/nutch/analysis/lang/package-use.html | 12 +-
.../apache/nutch/collection/CollectionManager.html | 16 +-
.../org/apache/nutch/collection/Subcollection.html | 12 +-
.../collection/class-use/CollectionManager.html | 12 +-
.../nutch/collection/class-use/Subcollection.html | 19 +-
.../apache/nutch/collection/package-summary.html | 12 +-
.../org/apache/nutch/collection/package-tree.html | 12 +-
.../org/apache/nutch/collection/package-use.html | 12 +-
.../apache/nutch/crawl/AbstractFetchSchedule.html | 12 +-
.../apache/nutch/crawl/AdaptiveFetchSchedule.html | 72 +-
.../apache/nutch/crawl/CrawlDatum.Comparator.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDatum.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDb.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbFilter.html | 12 +-
.../apache/nutch/crawl/CrawlDbMerger.Merger.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbMerger.html | 12 +-
...CrawlDatumCsvOutputFormat.LineRecordWriter.html | 12 +-
.../CrawlDbReader.CrawlDatumCsvOutputFormat.html | 12 +-
...rawlDatumJsonOutputFormat.LineRecordWriter.html | 12 +-
...wlDatumJsonOutputFormat.WritableSerializer.html | 12 +-
.../CrawlDbReader.CrawlDatumJsonOutputFormat.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbDumpMapper.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbStatMapper.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbStatReducer.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbTopNMapper.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbTopNReducer.html | 12 +-
.../nutch/crawl/CrawlDbReader.JsonIndenter.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbReader.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbReducer.html | 12 +-
.../nutch/crawl/DeduplicationJob.DBFilter.html | 12 +-
.../nutch/crawl/DeduplicationJob.DedupReducer.html | 12 +-
.../DeduplicationJob.StatusUpdateReducer.html | 12 +-
.../org/apache/nutch/crawl/DeduplicationJob.html | 12 +-
.../apache/nutch/crawl/DefaultFetchSchedule.html | 12 +-
.../api/org/apache/nutch/crawl/FetchSchedule.html | 12 +-
.../apache/nutch/crawl/FetchScheduleFactory.html | 12 +-
...nerator.CrawlDbUpdater.CrawlDbUpdateMapper.html | 12 +-
...erator.CrawlDbUpdater.CrawlDbUpdateReducer.html | 12 +-
.../nutch/crawl/Generator.CrawlDbUpdater.html | 12 +-
.../crawl/Generator.DecreasingFloatComparator.html | 12 +-
.../nutch/crawl/Generator.HashComparator.html | 12 +-
.../nutch/crawl/Generator.PartitionReducer.html | 12 +-
.../org/apache/nutch/crawl/Generator.Selector.html | 12 +-
.../nutch/crawl/Generator.SelectorEntry.html | 12 +-
.../crawl/Generator.SelectorInverseMapper.html | 12 +-
.../nutch/crawl/Generator.SelectorMapper.html | 12 +-
.../nutch/crawl/Generator.SelectorReducer.html | 12 +-
.../api/org/apache/nutch/crawl/Generator.html | 98 ++-
.../apache/nutch/crawl/Injector.InjectMapper.html | 12 +-
.../apache/nutch/crawl/Injector.InjectReducer.html | 12 +-
.../api/org/apache/nutch/crawl/Injector.html | 12 +-
.../javadoc/api/org/apache/nutch/crawl/Inlink.html | 52 +-
.../api/org/apache/nutch/crawl/Inlinks.html | 12 +-
.../apache/nutch/crawl/LinkDb.LinkDbMapper.html | 12 +-
.../javadoc/api/org/apache/nutch/crawl/LinkDb.html | 12 +-
.../api/org/apache/nutch/crawl/LinkDbFilter.html | 12 +-
.../crawl/LinkDbMerger.LinkDbMergeReducer.html | 12 +-
.../api/org/apache/nutch/crawl/LinkDbMerger.html | 12 +-
.../nutch/crawl/LinkDbReader.LinkDBDumpMapper.html | 12 +-
.../api/org/apache/nutch/crawl/LinkDbReader.html | 12 +-
.../api/org/apache/nutch/crawl/MD5Signature.html | 12 +-
.../nutch/crawl/MimeAdaptiveFetchSchedule.html | 14 +-
.../api/org/apache/nutch/crawl/NutchWritable.html | 12 +-
.../api/org/apache/nutch/crawl/Signature.html | 12 +-
.../apache/nutch/crawl/SignatureComparator.html | 12 +-
.../org/apache/nutch/crawl/SignatureFactory.html | 12 +-
.../org/apache/nutch/crawl/TextMD5Signature.html | 12 +-
.../apache/nutch/crawl/TextProfileSignature.html | 12 +-
.../api/org/apache/nutch/crawl/URLPartitioner.html | 12 +-
.../crawl/class-use/AbstractFetchSchedule.html | 12 +-
.../crawl/class-use/AdaptiveFetchSchedule.html | 12 +-
.../crawl/class-use/CrawlDatum.Comparator.html | 12 +-
.../apache/nutch/crawl/class-use/CrawlDatum.html | 52 +-
.../org/apache/nutch/crawl/class-use/CrawlDb.html | 12 +-
.../nutch/crawl/class-use/CrawlDbFilter.html | 12 +-
.../crawl/class-use/CrawlDbMerger.Merger.html | 12 +-
.../nutch/crawl/class-use/CrawlDbMerger.html | 12 +-
...CrawlDatumCsvOutputFormat.LineRecordWriter.html | 12 +-
.../CrawlDbReader.CrawlDatumCsvOutputFormat.html | 12 +-
...rawlDatumJsonOutputFormat.LineRecordWriter.html | 12 +-
...wlDatumJsonOutputFormat.WritableSerializer.html | 12 +-
.../CrawlDbReader.CrawlDatumJsonOutputFormat.html | 12 +-
.../class-use/CrawlDbReader.CrawlDbDumpMapper.html | 12 +-
.../class-use/CrawlDbReader.CrawlDbStatMapper.html | 12 +-
.../CrawlDbReader.CrawlDbStatReducer.html | 12 +-
.../class-use/CrawlDbReader.CrawlDbTopNMapper.html | 12 +-
.../CrawlDbReader.CrawlDbTopNReducer.html | 12 +-
.../class-use/CrawlDbReader.JsonIndenter.html | 12 +-
.../nutch/crawl/class-use/CrawlDbReader.html | 12 +-
.../nutch/crawl/class-use/CrawlDbReducer.html | 12 +-
.../crawl/class-use/DeduplicationJob.DBFilter.html | 12 +-
.../class-use/DeduplicationJob.DedupReducer.html | 12 +-
.../DeduplicationJob.StatusUpdateReducer.html | 12 +-
.../nutch/crawl/class-use/DeduplicationJob.html | 12 +-
.../crawl/class-use/DefaultFetchSchedule.html | 12 +-
.../nutch/crawl/class-use/FetchSchedule.html | 12 +-
.../crawl/class-use/FetchScheduleFactory.html | 12 +-
...nerator.CrawlDbUpdater.CrawlDbUpdateMapper.html | 12 +-
...erator.CrawlDbUpdater.CrawlDbUpdateReducer.html | 12 +-
.../crawl/class-use/Generator.CrawlDbUpdater.html | 12 +-
.../Generator.DecreasingFloatComparator.html | 12 +-
.../crawl/class-use/Generator.HashComparator.html | 12 +-
.../class-use/Generator.PartitionReducer.html | 12 +-
.../nutch/crawl/class-use/Generator.Selector.html | 12 +-
.../crawl/class-use/Generator.SelectorEntry.html | 12 +-
.../class-use/Generator.SelectorInverseMapper.html | 12 +-
.../crawl/class-use/Generator.SelectorMapper.html | 12 +-
.../crawl/class-use/Generator.SelectorReducer.html | 12 +-
.../apache/nutch/crawl/class-use/Generator.html | 12 +-
.../crawl/class-use/Injector.InjectMapper.html | 12 +-
.../crawl/class-use/Injector.InjectReducer.html | 12 +-
.../org/apache/nutch/crawl/class-use/Injector.html | 12 +-
.../org/apache/nutch/crawl/class-use/Inlink.html | 12 +-
.../org/apache/nutch/crawl/class-use/Inlinks.html | 46 +-
.../nutch/crawl/class-use/LinkDb.LinkDbMapper.html | 12 +-
.../org/apache/nutch/crawl/class-use/LinkDb.html | 12 +-
.../apache/nutch/crawl/class-use/LinkDbFilter.html | 12 +-
.../class-use/LinkDbMerger.LinkDbMergeReducer.html | 12 +-
.../apache/nutch/crawl/class-use/LinkDbMerger.html | 12 +-
.../class-use/LinkDbReader.LinkDBDumpMapper.html | 12 +-
.../apache/nutch/crawl/class-use/LinkDbReader.html | 12 +-
.../apache/nutch/crawl/class-use/MD5Signature.html | 12 +-
.../crawl/class-use/MimeAdaptiveFetchSchedule.html | 12 +-
.../nutch/crawl/class-use/NutchWritable.html | 12 +-
.../apache/nutch/crawl/class-use/Signature.html | 12 +-
.../nutch/crawl/class-use/SignatureComparator.html | 12 +-
.../nutch/crawl/class-use/SignatureFactory.html | 12 +-
.../nutch/crawl/class-use/TextMD5Signature.html | 12 +-
.../crawl/class-use/TextProfileSignature.html | 12 +-
.../nutch/crawl/class-use/URLPartitioner.html | 12 +-
.../org/apache/nutch/crawl/package-summary.html | 14 +-
.../api/org/apache/nutch/crawl/package-tree.html | 12 +-
.../api/org/apache/nutch/crawl/package-use.html | 53 +-
.../api/org/apache/nutch/exchange/Exchange.html | 12 +-
.../org/apache/nutch/exchange/ExchangeConfig.html | 12 +-
.../api/org/apache/nutch/exchange/Exchanges.html | 12 +-
.../apache/nutch/exchange/class-use/Exchange.html | 12 +-
.../nutch/exchange/class-use/ExchangeConfig.html | 12 +-
.../apache/nutch/exchange/class-use/Exchanges.html | 12 +-
.../apache/nutch/exchange/jexl/JexlExchange.html | 12 +-
.../exchange/jexl/class-use/JexlExchange.html | 12 +-
.../nutch/exchange/jexl/package-summary.html | 12 +-
.../apache/nutch/exchange/jexl/package-tree.html | 12 +-
.../apache/nutch/exchange/jexl/package-use.html | 12 +-
.../org/apache/nutch/exchange/package-summary.html | 12 +-
.../org/apache/nutch/exchange/package-tree.html | 12 +-
.../api/org/apache/nutch/exchange/package-use.html | 12 +-
.../api/org/apache/nutch/fetcher/FetchItem.html | 12 +-
.../org/apache/nutch/fetcher/FetchItemQueue.html | 12 +-
.../org/apache/nutch/fetcher/FetchItemQueues.html | 40 +-
.../api/org/apache/nutch/fetcher/FetchNode.html | 12 +-
.../api/org/apache/nutch/fetcher/FetchNodeDb.html | 12 +-
.../apache/nutch/fetcher/Fetcher.FetcherRun.html | 12 +-
.../apache/nutch/fetcher/Fetcher.InputFormat.html | 12 +-
.../api/org/apache/nutch/fetcher/Fetcher.html | 22 +-
.../apache/nutch/fetcher/FetcherOutputFormat.html | 12 +-
.../org/apache/nutch/fetcher/FetcherThread.html | 12 +-
.../FetcherThreadEvent.PublishEventType.html | 12 +-
.../apache/nutch/fetcher/FetcherThreadEvent.html | 20 +-
.../nutch/fetcher/FetcherThreadPublisher.html | 12 +-
.../api/org/apache/nutch/fetcher/QueueFeeder.html | 28 +-
.../apache/nutch/fetcher/class-use/FetchItem.html | 12 +-
.../nutch/fetcher/class-use/FetchItemQueue.html | 12 +-
.../nutch/fetcher/class-use/FetchItemQueues.html | 12 +-
.../apache/nutch/fetcher/class-use/FetchNode.html | 12 +-
.../nutch/fetcher/class-use/FetchNodeDb.html | 12 +-
.../fetcher/class-use/Fetcher.FetcherRun.html | 12 +-
.../fetcher/class-use/Fetcher.InputFormat.html | 12 +-
.../apache/nutch/fetcher/class-use/Fetcher.html | 12 +-
.../fetcher/class-use/FetcherOutputFormat.html | 12 +-
.../nutch/fetcher/class-use/FetcherThread.html | 12 +-
.../FetcherThreadEvent.PublishEventType.html | 12 +-
.../fetcher/class-use/FetcherThreadEvent.html | 12 +-
.../fetcher/class-use/FetcherThreadPublisher.html | 12 +-
.../nutch/fetcher/class-use/QueueFeeder.html | 12 +-
.../org/apache/nutch/fetcher/package-summary.html | 12 +-
.../api/org/apache/nutch/fetcher/package-tree.html | 12 +-
.../api/org/apache/nutch/fetcher/package-use.html | 12 +-
.../apache/nutch/hostdb/CrawlDatumProcessor.html | 12 +-
.../hostdb/FetchOverdueCrawlDatumProcessor.html | 12 +-
.../api/org/apache/nutch/hostdb/HostDatum.html | 12 +-
.../api/org/apache/nutch/hostdb/ReadHostDb.html | 12 +-
.../org/apache/nutch/hostdb/ResolverThread.html | 12 +-
.../api/org/apache/nutch/hostdb/UpdateHostDb.html | 34 +-
.../apache/nutch/hostdb/UpdateHostDbMapper.html | 12 +-
.../apache/nutch/hostdb/UpdateHostDbReducer.html | 26 +-
.../hostdb/class-use/CrawlDatumProcessor.html | 12 +-
.../class-use/FetchOverdueCrawlDatumProcessor.html | 12 +-
.../apache/nutch/hostdb/class-use/HostDatum.html | 12 +-
.../apache/nutch/hostdb/class-use/ReadHostDb.html | 12 +-
.../nutch/hostdb/class-use/ResolverThread.html | 12 +-
.../nutch/hostdb/class-use/UpdateHostDb.html | 12 +-
.../nutch/hostdb/class-use/UpdateHostDbMapper.html | 12 +-
.../hostdb/class-use/UpdateHostDbReducer.html | 12 +-
.../org/apache/nutch/hostdb/package-summary.html | 12 +-
.../api/org/apache/nutch/hostdb/package-tree.html | 12 +-
.../api/org/apache/nutch/hostdb/package-use.html | 12 +-
.../apache/nutch/indexer/CleaningJob.DBFilter.html | 12 +-
.../nutch/indexer/CleaningJob.DeleterReducer.html | 12 +-
.../api/org/apache/nutch/indexer/CleaningJob.html | 12 +-
.../api/org/apache/nutch/indexer/IndexWriter.html | 12 +-
.../apache/nutch/indexer/IndexWriterConfig.html | 12 +-
.../apache/nutch/indexer/IndexWriterParams.html | 12 +-
.../indexer/IndexWriters.IndexWriterWrapper.html | 12 +-
.../api/org/apache/nutch/indexer/IndexWriters.html | 12 +-
.../indexer/IndexerMapReduce.IndexerMapper.html | 12 +-
.../indexer/IndexerMapReduce.IndexerReducer.html | 12 +-
.../org/apache/nutch/indexer/IndexerMapReduce.html | 12 +-
.../apache/nutch/indexer/IndexerOutputFormat.html | 12 +-
.../apache/nutch/indexer/IndexingException.html | 12 +-
.../org/apache/nutch/indexer/IndexingFilter.html | 12 +-
.../org/apache/nutch/indexer/IndexingFilters.html | 12 +-
.../nutch/indexer/IndexingFiltersChecker.html | 12 +-
.../api/org/apache/nutch/indexer/IndexingJob.html | 12 +-
.../org/apache/nutch/indexer/NutchDocument.html | 12 +-
.../api/org/apache/nutch/indexer/NutchField.html | 12 +-
.../org/apache/nutch/indexer/NutchIndexAction.html | 12 +-
.../nutch/indexer/anchor/AnchorIndexingFilter.html | 12 +-
.../anchor/class-use/AnchorIndexingFilter.html | 12 +-
.../nutch/indexer/anchor/package-summary.html | 12 +-
.../apache/nutch/indexer/anchor/package-tree.html | 12 +-
.../apache/nutch/indexer/anchor/package-use.html | 12 +-
.../indexer/arbitrary/ArbitraryIndexingFilter.html | 12 +-
.../class-use/ArbitraryIndexingFilter.html | 12 +-
.../nutch/indexer/arbitrary/package-summary.html | 12 +-
.../nutch/indexer/arbitrary/package-tree.html | 12 +-
.../nutch/indexer/arbitrary/package-use.html | 12 +-
.../nutch/indexer/basic/BasicIndexingFilter.html | 12 +-
.../basic/class-use/BasicIndexingFilter.html | 12 +-
.../nutch/indexer/basic/package-summary.html | 12 +-
.../apache/nutch/indexer/basic/package-tree.html | 12 +-
.../apache/nutch/indexer/basic/package-use.html | 12 +-
.../indexer/class-use/CleaningJob.DBFilter.html | 12 +-
.../class-use/CleaningJob.DeleterReducer.html | 12 +-
.../nutch/indexer/class-use/CleaningJob.html | 12 +-
.../nutch/indexer/class-use/IndexWriter.html | 12 +-
.../nutch/indexer/class-use/IndexWriterConfig.html | 12 +-
.../nutch/indexer/class-use/IndexWriterParams.html | 12 +-
.../class-use/IndexWriters.IndexWriterWrapper.html | 12 +-
.../nutch/indexer/class-use/IndexWriters.html | 12 +-
.../class-use/IndexerMapReduce.IndexerMapper.html | 12 +-
.../class-use/IndexerMapReduce.IndexerReducer.html | 12 +-
.../nutch/indexer/class-use/IndexerMapReduce.html | 12 +-
.../indexer/class-use/IndexerOutputFormat.html | 12 +-
.../nutch/indexer/class-use/IndexingException.html | 12 +-
.../nutch/indexer/class-use/IndexingFilter.html | 14 +-
.../nutch/indexer/class-use/IndexingFilters.html | 12 +-
.../indexer/class-use/IndexingFiltersChecker.html | 12 +-
.../nutch/indexer/class-use/IndexingJob.html | 12 +-
.../nutch/indexer/class-use/NutchDocument.html | 48 +-
.../apache/nutch/indexer/class-use/NutchField.html | 12 +-
.../nutch/indexer/class-use/NutchIndexAction.html | 12 +-
.../nutch/indexer/feed/FeedIndexingFilter.html | 12 +-
.../indexer/feed/class-use/FeedIndexingFilter.html | 12 +-
.../apache/nutch/indexer/feed/package-summary.html | 12 +-
.../apache/nutch/indexer/feed/package-tree.html | 12 +-
.../org/apache/nutch/indexer/feed/package-use.html | 12 +-
.../indexer/filter/MimeTypeIndexingFilter.html | 12 +-
.../filter/class-use/MimeTypeIndexingFilter.html | 12 +-
.../nutch/indexer/filter/package-summary.html | 12 +-
.../apache/nutch/indexer/filter/package-tree.html | 12 +-
.../apache/nutch/indexer/filter/package-use.html | 12 +-
.../nutch/indexer/geoip/GeoIPDocumentCreator.html | 12 +-
.../nutch/indexer/geoip/GeoIPIndexingFilter.html | 12 +-
.../geoip/class-use/GeoIPDocumentCreator.html | 12 +-
.../geoip/class-use/GeoIPIndexingFilter.html | 12 +-
.../nutch/indexer/geoip/package-summary.html | 12 +-
.../apache/nutch/indexer/geoip/package-tree.html | 12 +-
.../apache/nutch/indexer/geoip/package-use.html | 12 +-
.../nutch/indexer/jexl/JexlIndexingFilter.html | 12 +-
.../indexer/jexl/class-use/JexlIndexingFilter.html | 12 +-
.../apache/nutch/indexer/jexl/package-summary.html | 12 +-
.../apache/nutch/indexer/jexl/package-tree.html | 12 +-
.../org/apache/nutch/indexer/jexl/package-use.html | 12 +-
.../nutch/indexer/links/LinksIndexingFilter.html | 12 +-
.../links/class-use/LinksIndexingFilter.html | 12 +-
.../nutch/indexer/links/package-summary.html | 12 +-
.../apache/nutch/indexer/links/package-tree.html | 12 +-
.../apache/nutch/indexer/links/package-use.html | 12 +-
.../nutch/indexer/metadata/MetadataIndexer.html | 12 +-
.../metadata/class-use/MetadataIndexer.html | 12 +-
.../nutch/indexer/metadata/package-summary.html | 12 +-
.../nutch/indexer/metadata/package-tree.html | 12 +-
.../apache/nutch/indexer/metadata/package-use.html | 12 +-
.../nutch/indexer/more/MoreIndexingFilter.html | 12 +-
.../indexer/more/class-use/MoreIndexingFilter.html | 12 +-
.../apache/nutch/indexer/more/package-summary.html | 12 +-
.../apache/nutch/indexer/more/package-tree.html | 12 +-
.../org/apache/nutch/indexer/more/package-use.html | 12 +-
.../org/apache/nutch/indexer/package-summary.html | 12 +-
.../api/org/apache/nutch/indexer/package-tree.html | 12 +-
.../api/org/apache/nutch/indexer/package-use.html | 39 +-
.../nutch/indexer/replace/FieldReplacer.html | 12 +-
.../nutch/indexer/replace/ReplaceIndexer.html | 12 +-
.../indexer/replace/class-use/FieldReplacer.html | 12 +-
.../indexer/replace/class-use/ReplaceIndexer.html | 12 +-
.../nutch/indexer/replace/package-summary.html | 12 +-
.../apache/nutch/indexer/replace/package-tree.html | 12 +-
.../apache/nutch/indexer/replace/package-use.html | 12 +-
.../indexer/staticfield/StaticFieldIndexer.html | 12 +-
.../staticfield/class-use/StaticFieldIndexer.html | 12 +-
.../nutch/indexer/staticfield/package-summary.html | 12 +-
.../nutch/indexer/staticfield/package-tree.html | 12 +-
.../nutch/indexer/staticfield/package-use.html | 12 +-
.../subcollection/SubcollectionIndexingFilter.html | 12 +-
.../class-use/SubcollectionIndexingFilter.html | 12 +-
.../indexer/subcollection/package-summary.html | 12 +-
.../nutch/indexer/subcollection/package-tree.html | 12 +-
.../nutch/indexer/subcollection/package-use.html | 12 +-
.../nutch/indexer/tld/TLDIndexingFilter.html | 20 +-
.../indexer/tld/class-use/TLDIndexingFilter.html | 12 +-
.../apache/nutch/indexer/tld/package-summary.html | 14 +-
.../org/apache/nutch/indexer/tld/package-tree.html | 12 +-
.../org/apache/nutch/indexer/tld/package-use.html | 12 +-
.../indexer/urlmeta/URLMetaIndexingFilter.html | 12 +-
.../urlmeta/class-use/URLMetaIndexingFilter.html | 12 +-
.../nutch/indexer/urlmeta/package-summary.html | 12 +-
.../apache/nutch/indexer/urlmeta/package-tree.html | 12 +-
.../apache/nutch/indexer/urlmeta/package-use.html | 12 +-
.../cloudsearch/CloudSearchConstants.html | 12 +-
.../cloudsearch/CloudSearchIndexWriter.html | 12 +-
.../indexwriter/cloudsearch/CloudSearchUtils.html | 12 +-
.../class-use/CloudSearchConstants.html | 12 +-
.../class-use/CloudSearchIndexWriter.html | 12 +-
.../cloudsearch/class-use/CloudSearchUtils.html | 12 +-
.../indexwriter/cloudsearch/package-summary.html | 12 +-
.../indexwriter/cloudsearch/package-tree.html | 12 +-
.../nutch/indexwriter/cloudsearch/package-use.html | 12 +-
.../apache/nutch/indexwriter/csv/CSVConstants.html | 12 +-
.../indexwriter/csv/CSVIndexWriter.Separator.html | 12 +-
.../nutch/indexwriter/csv/CSVIndexWriter.html | 12 +-
.../indexwriter/csv/class-use/CSVConstants.html | 12 +-
.../csv/class-use/CSVIndexWriter.Separator.html | 12 +-
.../indexwriter/csv/class-use/CSVIndexWriter.html | 12 +-
.../nutch/indexwriter/csv/package-summary.html | 12 +-
.../apache/nutch/indexwriter/csv/package-tree.html | 12 +-
.../apache/nutch/indexwriter/csv/package-use.html | 12 +-
.../nutch/indexwriter/dummy/DummyConstants.html | 12 +-
.../nutch/indexwriter/dummy/DummyIndexWriter.html | 12 +-
.../dummy/class-use/DummyConstants.html | 12 +-
.../dummy/class-use/DummyIndexWriter.html | 12 +-
.../nutch/indexwriter/dummy/package-summary.html | 12 +-
.../nutch/indexwriter/dummy/package-tree.html | 12 +-
.../nutch/indexwriter/dummy/package-use.html | 12 +-
.../indexwriter/elastic/ElasticConstants.html | 12 +-
.../indexwriter/elastic/ElasticIndexWriter.html | 12 +-
.../elastic/class-use/ElasticConstants.html | 12 +-
.../elastic/class-use/ElasticIndexWriter.html | 12 +-
.../nutch/indexwriter/elastic/package-summary.html | 12 +-
.../nutch/indexwriter/elastic/package-tree.html | 12 +-
.../nutch/indexwriter/elastic/package-use.html | 12 +-
.../nutch/indexwriter/kafka/KafkaConstants.html | 12 +-
.../nutch/indexwriter/kafka/KafkaIndexWriter.html | 12 +-
.../kafka/class-use/KafkaConstants.html | 12 +-
.../kafka/class-use/KafkaIndexWriter.html | 12 +-
.../nutch/indexwriter/kafka/package-summary.html | 12 +-
.../nutch/indexwriter/kafka/package-tree.html | 12 +-
.../nutch/indexwriter/kafka/package-use.html | 12 +-
.../opensearch1x/OpenSearch1xConstants.html | 12 +-
.../opensearch1x/OpenSearch1xIndexWriter.html | 12 +-
.../class-use/OpenSearch1xConstants.html | 12 +-
.../class-use/OpenSearch1xIndexWriter.html | 12 +-
.../indexwriter/opensearch1x/package-summary.html | 12 +-
.../indexwriter/opensearch1x/package-tree.html | 12 +-
.../indexwriter/opensearch1x/package-use.html | 12 +-
.../indexwriter/rabbit/RabbitIndexWriter.html | 12 +-
.../rabbit/class-use/RabbitIndexWriter.html | 12 +-
.../nutch/indexwriter/rabbit/package-summary.html | 12 +-
.../nutch/indexwriter/rabbit/package-tree.html | 12 +-
.../nutch/indexwriter/rabbit/package-use.html | 12 +-
.../nutch/indexwriter/solr/SolrConstants.html | 12 +-
.../nutch/indexwriter/solr/SolrIndexWriter.html | 12 +-
.../apache/nutch/indexwriter/solr/SolrUtils.html | 12 +-
.../indexwriter/solr/class-use/SolrConstants.html | 12 +-
.../solr/class-use/SolrIndexWriter.html | 12 +-
.../indexwriter/solr/class-use/SolrUtils.html | 12 +-
.../nutch/indexwriter/solr/package-summary.html | 12 +-
.../nutch/indexwriter/solr/package-tree.html | 12 +-
.../apache/nutch/indexwriter/solr/package-use.html | 12 +-
.../nutch/metadata/CaseInsensitiveMetadata.html | 12 +-
.../org/apache/nutch/metadata/CreativeCommons.html | 12 +-
.../api/org/apache/nutch/metadata/DublinCore.html | 12 +-
.../api/org/apache/nutch/metadata/Feed.html | 12 +-
.../api/org/apache/nutch/metadata/HttpHeaders.html | 12 +-
.../api/org/apache/nutch/metadata/MetaWrapper.html | 12 +-
.../api/org/apache/nutch/metadata/Metadata.html | 12 +-
.../api/org/apache/nutch/metadata/Nutch.html | 12 +-
.../nutch/metadata/SpellCheckedMetadata.html | 12 +-
.../class-use/CaseInsensitiveMetadata.html | 12 +-
.../nutch/metadata/class-use/CreativeCommons.html | 12 +-
.../nutch/metadata/class-use/DublinCore.html | 12 +-
.../org/apache/nutch/metadata/class-use/Feed.html | 12 +-
.../nutch/metadata/class-use/HttpHeaders.html | 12 +-
.../nutch/metadata/class-use/MetaWrapper.html | 12 +-
.../apache/nutch/metadata/class-use/Metadata.html | 12 +-
.../org/apache/nutch/metadata/class-use/Nutch.html | 12 +-
.../metadata/class-use/SpellCheckedMetadata.html | 12 +-
.../org/apache/nutch/metadata/package-summary.html | 12 +-
.../org/apache/nutch/metadata/package-tree.html | 12 +-
.../api/org/apache/nutch/metadata/package-use.html | 12 +-
.../microformats/reltag/RelTagIndexingFilter.html | 12 +-
.../nutch/microformats/reltag/RelTagParser.html | 12 +-
.../reltag/class-use/RelTagIndexingFilter.html | 12 +-
.../reltag/class-use/RelTagParser.html | 12 +-
.../nutch/microformats/reltag/package-summary.html | 12 +-
.../nutch/microformats/reltag/package-tree.html | 12 +-
.../nutch/microformats/reltag/package-use.html | 12 +-
.../org/apache/nutch/net/URLExemptionFilter.html | 12 +-
.../org/apache/nutch/net/URLExemptionFilters.html | 12 +-
.../api/org/apache/nutch/net/URLFilter.html | 12 +-
.../api/org/apache/nutch/net/URLFilterChecker.html | 12 +-
.../org/apache/nutch/net/URLFilterException.html | 12 +-
.../api/org/apache/nutch/net/URLFilters.html | 12 +-
.../api/org/apache/nutch/net/URLNormalizer.html | 12 +-
.../org/apache/nutch/net/URLNormalizerChecker.html | 12 +-
.../api/org/apache/nutch/net/URLNormalizers.html | 12 +-
.../nutch/net/class-use/URLExemptionFilter.html | 17 +-
.../nutch/net/class-use/URLExemptionFilters.html | 12 +-
.../org/apache/nutch/net/class-use/URLFilter.html | 17 +-
.../nutch/net/class-use/URLFilterChecker.html | 12 +-
.../nutch/net/class-use/URLFilterException.html | 12 +-
.../org/apache/nutch/net/class-use/URLFilters.html | 12 +-
.../apache/nutch/net/class-use/URLNormalizer.html | 12 +-
.../nutch/net/class-use/URLNormalizerChecker.html | 12 +-
.../apache/nutch/net/class-use/URLNormalizers.html | 12 +-
.../api/org/apache/nutch/net/package-summary.html | 12 +-
.../api/org/apache/nutch/net/package-tree.html | 12 +-
.../api/org/apache/nutch/net/package-use.html | 12 +-
.../apache/nutch/net/protocols/HttpDateFormat.html | 12 +-
.../nutch/net/protocols/ProtocolException.html | 12 +-
.../nutch/net/protocols/ProtocolLogUtil.html | 12 +-
.../protocols/Response.TruncatedContentReason.html | 12 +-
.../org/apache/nutch/net/protocols/Response.html | 60 +-
.../net/protocols/class-use/HttpDateFormat.html | 12 +-
.../net/protocols/class-use/ProtocolException.html | 12 +-
.../net/protocols/class-use/ProtocolLogUtil.html | 12 +-
.../class-use/Response.TruncatedContentReason.html | 12 +-
.../nutch/net/protocols/class-use/Response.html | 12 +-
.../nutch/net/protocols/package-summary.html | 12 +-
.../apache/nutch/net/protocols/package-tree.html | 12 +-
.../apache/nutch/net/protocols/package-use.html | 12 +-
.../net/urlnormalizer/ajax/AjaxURLNormalizer.html | 12 +-
.../ajax/class-use/AjaxURLNormalizer.html | 12 +-
.../net/urlnormalizer/ajax/package-summary.html | 12 +-
.../nutch/net/urlnormalizer/ajax/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/ajax/package-use.html | 12 +-
.../urlnormalizer/basic/BasicURLNormalizer.html | 12 +-
.../basic/class-use/BasicURLNormalizer.html | 12 +-
.../net/urlnormalizer/basic/package-summary.html | 12 +-
.../net/urlnormalizer/basic/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/basic/package-use.html | 12 +-
.../net/urlnormalizer/host/HostURLNormalizer.html | 12 +-
.../host/class-use/HostURLNormalizer.html | 12 +-
.../net/urlnormalizer/host/package-summary.html | 12 +-
.../nutch/net/urlnormalizer/host/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/host/package-use.html | 12 +-
.../net/urlnormalizer/pass/PassURLNormalizer.html | 12 +-
.../pass/class-use/PassURLNormalizer.html | 12 +-
.../net/urlnormalizer/pass/package-summary.html | 12 +-
.../nutch/net/urlnormalizer/pass/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/pass/package-use.html | 12 +-
.../protocol/ProtocolURLNormalizer.html | 12 +-
.../protocol/class-use/ProtocolURLNormalizer.html | 12 +-
.../urlnormalizer/protocol/package-summary.html | 12 +-
.../net/urlnormalizer/protocol/package-tree.html | 12 +-
.../net/urlnormalizer/protocol/package-use.html | 12 +-
.../querystring/QuerystringURLNormalizer.html | 12 +-
.../class-use/QuerystringURLNormalizer.html | 12 +-
.../urlnormalizer/querystring/package-summary.html | 12 +-
.../urlnormalizer/querystring/package-tree.html | 12 +-
.../net/urlnormalizer/querystring/package-use.html | 12 +-
.../urlnormalizer/regex/RegexURLNormalizer.html | 12 +-
.../regex/class-use/RegexURLNormalizer.html | 12 +-
.../net/urlnormalizer/regex/package-summary.html | 12 +-
.../net/urlnormalizer/regex/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/regex/package-use.html | 12 +-
.../urlnormalizer/slash/SlashURLNormalizer.html | 12 +-
.../slash/class-use/SlashURLNormalizer.html | 12 +-
.../net/urlnormalizer/slash/package-summary.html | 12 +-
.../net/urlnormalizer/slash/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/slash/package-use.html | 12 +-
.../api/org/apache/nutch/parse/HTMLMetaTags.html | 12 +-
.../org/apache/nutch/parse/HtmlParseFilter.html | 12 +-
.../org/apache/nutch/parse/HtmlParseFilters.html | 12 +-
.../api/org/apache/nutch/parse/Outlink.html | 12 +-
.../org/apache/nutch/parse/OutlinkExtractor.html | 12 +-
.../javadoc/api/org/apache/nutch/parse/Parse.html | 12 +-
.../api/org/apache/nutch/parse/ParseData.html | 12 +-
.../api/org/apache/nutch/parse/ParseException.html | 12 +-
.../api/org/apache/nutch/parse/ParseImpl.html | 12 +-
.../org/apache/nutch/parse/ParseOutputFormat.html | 12 +-
.../api/org/apache/nutch/parse/ParseResult.html | 12 +-
.../parse/ParseSegment.ParseSegmentMapper.html | 12 +-
.../parse/ParseSegment.ParseSegmentReducer.html | 12 +-
.../api/org/apache/nutch/parse/ParseSegment.html | 12 +-
.../api/org/apache/nutch/parse/ParseStatus.html | 12 +-
.../api/org/apache/nutch/parse/ParseText.html | 12 +-
.../api/org/apache/nutch/parse/ParseUtil.html | 12 +-
.../javadoc/api/org/apache/nutch/parse/Parser.html | 12 +-
.../api/org/apache/nutch/parse/ParserChecker.html | 12 +-
.../api/org/apache/nutch/parse/ParserFactory.html | 12 +-
.../api/org/apache/nutch/parse/ParserNotFound.html | 12 +-
.../apache/nutch/parse/class-use/HTMLMetaTags.html | 12 +-
.../nutch/parse/class-use/HtmlParseFilter.html | 12 +-
.../nutch/parse/class-use/HtmlParseFilters.html | 12 +-
.../org/apache/nutch/parse/class-use/Outlink.html | 12 +-
.../nutch/parse/class-use/OutlinkExtractor.html | 12 +-
.../org/apache/nutch/parse/class-use/Parse.html | 48 +-
.../apache/nutch/parse/class-use/ParseData.html | 12 +-
.../nutch/parse/class-use/ParseException.html | 12 +-
.../apache/nutch/parse/class-use/ParseImpl.html | 12 +-
.../nutch/parse/class-use/ParseOutputFormat.html | 12 +-
.../apache/nutch/parse/class-use/ParseResult.html | 12 +-
.../class-use/ParseSegment.ParseSegmentMapper.html | 12 +-
.../ParseSegment.ParseSegmentReducer.html | 12 +-
.../apache/nutch/parse/class-use/ParseSegment.html | 12 +-
.../apache/nutch/parse/class-use/ParseStatus.html | 12 +-
.../apache/nutch/parse/class-use/ParseText.html | 12 +-
.../apache/nutch/parse/class-use/ParseUtil.html | 12 +-
.../org/apache/nutch/parse/class-use/Parser.html | 12 +-
.../nutch/parse/class-use/ParserChecker.html | 12 +-
.../nutch/parse/class-use/ParserFactory.html | 12 +-
.../nutch/parse/class-use/ParserNotFound.html | 12 +-
.../api/org/apache/nutch/parse/ext/ExtParser.html | 12 +-
.../nutch/parse/ext/class-use/ExtParser.html | 12 +-
.../apache/nutch/parse/ext/package-summary.html | 12 +-
.../org/apache/nutch/parse/ext/package-tree.html | 12 +-
.../org/apache/nutch/parse/ext/package-use.html | 12 +-
.../org/apache/nutch/parse/feed/FeedParser.html | 12 +-
.../nutch/parse/feed/class-use/FeedParser.html | 12 +-
.../apache/nutch/parse/feed/package-summary.html | 12 +-
.../org/apache/nutch/parse/feed/package-tree.html | 12 +-
.../org/apache/nutch/parse/feed/package-use.html | 12 +-
.../nutch/parse/headings/HeadingsParseFilter.html | 12 +-
.../headings/class-use/HeadingsParseFilter.html | 12 +-
.../nutch/parse/headings/package-summary.html | 12 +-
.../apache/nutch/parse/headings/package-tree.html | 12 +-
.../apache/nutch/parse/headings/package-use.html | 12 +-
.../org/apache/nutch/parse/html/DOMBuilder.html | 12 +-
.../parse/html/DOMContentUtils.LinkParams.html | 12 +-
.../apache/nutch/parse/html/DOMContentUtils.html | 12 +-
.../apache/nutch/parse/html/HTMLMetaProcessor.html | 12 +-
.../org/apache/nutch/parse/html/HtmlParser.html | 12 +-
.../nutch/parse/html/XMLCharacterRecognizer.html | 12 +-
.../nutch/parse/html/class-use/DOMBuilder.html | 12 +-
.../html/class-use/DOMContentUtils.LinkParams.html | 12 +-
.../parse/html/class-use/DOMContentUtils.html | 12 +-
.../parse/html/class-use/HTMLMetaProcessor.html | 12 +-
.../nutch/parse/html/class-use/HtmlParser.html | 12 +-
.../html/class-use/XMLCharacterRecognizer.html | 12 +-
.../apache/nutch/parse/html/package-summary.html | 12 +-
.../org/apache/nutch/parse/html/package-tree.html | 12 +-
.../org/apache/nutch/parse/html/package-use.html | 12 +-
.../org/apache/nutch/parse/js/JSParseFilter.html | 12 +-
.../nutch/parse/js/class-use/JSParseFilter.html | 12 +-
.../org/apache/nutch/parse/js/package-summary.html | 12 +-
.../org/apache/nutch/parse/js/package-tree.html | 12 +-
.../api/org/apache/nutch/parse/js/package-use.html | 12 +-
.../nutch/parse/metatags/MetaTagsParser.html | 12 +-
.../parse/metatags/class-use/MetaTagsParser.html | 12 +-
.../nutch/parse/metatags/package-summary.html | 12 +-
.../apache/nutch/parse/metatags/package-tree.html | 12 +-
.../apache/nutch/parse/metatags/package-use.html | 12 +-
.../org/apache/nutch/parse/package-summary.html | 12 +-
.../api/org/apache/nutch/parse/package-tree.html | 12 +-
.../api/org/apache/nutch/parse/package-use.html | 45 +-
.../apache/nutch/parse/tika/DOMContentUtils.html | 16 +-
.../apache/nutch/parse/tika/HTMLMetaProcessor.html | 12 +-
.../org/apache/nutch/parse/tika/TikaParser.html | 12 +-
.../parse/tika/class-use/DOMContentUtils.html | 12 +-
.../parse/tika/class-use/HTMLMetaProcessor.html | 12 +-
.../nutch/parse/tika/class-use/TikaParser.html | 12 +-
.../apache/nutch/parse/tika/package-summary.html | 12 +-
.../org/apache/nutch/parse/tika/package-tree.html | 12 +-
.../org/apache/nutch/parse/tika/package-use.html | 12 +-
.../api/org/apache/nutch/parse/zip/ZipParser.html | 12 +-
.../apache/nutch/parse/zip/ZipTextExtractor.html | 12 +-
.../nutch/parse/zip/class-use/ZipParser.html | 12 +-
.../parse/zip/class-use/ZipTextExtractor.html | 12 +-
.../apache/nutch/parse/zip/package-summary.html | 12 +-
.../org/apache/nutch/parse/zip/package-tree.html | 12 +-
.../org/apache/nutch/parse/zip/package-use.html | 12 +-
.../nutch/parsefilter/debug/DebugParseFilter.html | 12 +-
.../debug/class-use/DebugParseFilter.html | 12 +-
.../nutch/parsefilter/debug/package-summary.html | 12 +-
.../nutch/parsefilter/debug/package-tree.html | 12 +-
.../nutch/parsefilter/debug/package-use.html | 12 +-
.../nutch/parsefilter/naivebayes/Classify.html | 12 +-
.../naivebayes/NaiveBayesParseFilter.html | 12 +-
.../apache/nutch/parsefilter/naivebayes/Train.html | 12 +-
.../parsefilter/naivebayes/class-use/Classify.html | 12 +-
.../class-use/NaiveBayesParseFilter.html | 12 +-
.../parsefilter/naivebayes/class-use/Train.html | 12 +-
.../parsefilter/naivebayes/package-summary.html | 12 +-
.../nutch/parsefilter/naivebayes/package-tree.html | 12 +-
.../nutch/parsefilter/naivebayes/package-use.html | 12 +-
.../nutch/parsefilter/regex/RegexParseFilter.html | 12 +-
.../regex/class-use/RegexParseFilter.html | 12 +-
.../nutch/parsefilter/regex/package-summary.html | 12 +-
.../nutch/parsefilter/regex/package-tree.html | 12 +-
.../nutch/parsefilter/regex/package-use.html | 12 +-
.../nutch/plugin/CircularDependencyException.html | 12 +-
.../api/org/apache/nutch/plugin/Extension.html | 12 +-
.../org/apache/nutch/plugin/ExtensionPoint.html | 12 +-
.../nutch/plugin/MissingDependencyException.html | 12 +-
.../api/org/apache/nutch/plugin/Pluggable.html | 14 +-
.../api/org/apache/nutch/plugin/Plugin.html | 12 +-
.../org/apache/nutch/plugin/PluginClassLoader.html | 12 +-
.../org/apache/nutch/plugin/PluginDescriptor.html | 12 +-
.../apache/nutch/plugin/PluginManifestParser.html | 12 +-
.../org/apache/nutch/plugin/PluginRepository.html | 12 +-
.../nutch/plugin/PluginRuntimeException.html | 12 +-
.../nutch/plugin/URLStreamHandlerFactory.html | 18 +-
.../class-use/CircularDependencyException.html | 12 +-
.../apache/nutch/plugin/class-use/Extension.html | 12 +-
.../nutch/plugin/class-use/ExtensionPoint.html | 12 +-
.../class-use/MissingDependencyException.html | 12 +-
.../apache/nutch/plugin/class-use/Pluggable.html | 71 +-
.../org/apache/nutch/plugin/class-use/Plugin.html | 12 +-
.../nutch/plugin/class-use/PluginClassLoader.html | 12 +-
.../nutch/plugin/class-use/PluginDescriptor.html | 12 +-
.../plugin/class-use/PluginManifestParser.html | 12 +-
.../nutch/plugin/class-use/PluginRepository.html | 12 +-
.../plugin/class-use/PluginRuntimeException.html | 12 +-
.../plugin/class-use/URLStreamHandlerFactory.html | 12 +-
.../org/apache/nutch/plugin/package-summary.html | 12 +-
.../api/org/apache/nutch/plugin/package-tree.html | 12 +-
.../api/org/apache/nutch/plugin/package-use.html | 59 +-
.../api/org/apache/nutch/protocol/Content.html | 12 +-
.../api/org/apache/nutch/protocol/Protocol.html | 12 +-
.../apache/nutch/protocol/ProtocolException.html | 12 +-
.../org/apache/nutch/protocol/ProtocolFactory.html | 12 +-
.../apache/nutch/protocol/ProtocolNotFound.html | 12 +-
.../org/apache/nutch/protocol/ProtocolOutput.html | 12 +-
.../org/apache/nutch/protocol/ProtocolStatus.html | 12 +-
.../apache/nutch/protocol/RobotRulesParser.html | 12 +-
.../apache/nutch/protocol/class-use/Content.html | 12 +-
.../apache/nutch/protocol/class-use/Protocol.html | 12 +-
.../protocol/class-use/ProtocolException.html | 12 +-
.../nutch/protocol/class-use/ProtocolFactory.html | 12 +-
.../nutch/protocol/class-use/ProtocolNotFound.html | 12 +-
.../nutch/protocol/class-use/ProtocolOutput.html | 12 +-
.../nutch/protocol/class-use/ProtocolStatus.html | 12 +-
.../nutch/protocol/class-use/RobotRulesParser.html | 12 +-
.../api/org/apache/nutch/protocol/file/File.html | 12 +-
.../org/apache/nutch/protocol/file/FileError.html | 12 +-
.../apache/nutch/protocol/file/FileException.html | 12 +-
.../apache/nutch/protocol/file/FileResponse.html | 12 +-
.../apache/nutch/protocol/file/class-use/File.html | 12 +-
.../nutch/protocol/file/class-use/FileError.html | 12 +-
.../protocol/file/class-use/FileException.html | 12 +-
.../protocol/file/class-use/FileResponse.html | 12 +-
.../nutch/protocol/file/package-summary.html | 12 +-
.../apache/nutch/protocol/file/package-tree.html | 12 +-
.../apache/nutch/protocol/file/package-use.html | 12 +-
.../api/org/apache/nutch/protocol/ftp/Client.html | 12 +-
.../api/org/apache/nutch/protocol/ftp/Ftp.html | 12 +-
.../org/apache/nutch/protocol/ftp/FtpError.html | 12 +-
.../apache/nutch/protocol/ftp/FtpException.html | 12 +-
.../protocol/ftp/FtpExceptionBadSystResponse.html | 12 +-
.../ftp/FtpExceptionCanNotHaveDataConnection.html | 12 +-
...FtpExceptionControlClosedByForcedDataClose.html | 12 +-
.../ftp/FtpExceptionUnknownForcedDataClose.html | 12 +-
.../org/apache/nutch/protocol/ftp/FtpResponse.html | 12 +-
.../nutch/protocol/ftp/FtpRobotRulesParser.html | 12 +-
.../nutch/protocol/ftp/PrintCommandListener.html | 12 +-
.../nutch/protocol/ftp/class-use/Client.html | 12 +-
.../apache/nutch/protocol/ftp/class-use/Ftp.html | 12 +-
.../nutch/protocol/ftp/class-use/FtpError.html | 12 +-
.../nutch/protocol/ftp/class-use/FtpException.html | 12 +-
.../ftp/class-use/FtpExceptionBadSystResponse.html | 12 +-
.../FtpExceptionCanNotHaveDataConnection.html | 12 +-
...FtpExceptionControlClosedByForcedDataClose.html | 12 +-
.../FtpExceptionUnknownForcedDataClose.html | 12 +-
.../nutch/protocol/ftp/class-use/FtpResponse.html | 12 +-
.../ftp/class-use/FtpRobotRulesParser.html | 12 +-
.../ftp/class-use/PrintCommandListener.html | 12 +-
.../apache/nutch/protocol/ftp/package-summary.html | 12 +-
.../apache/nutch/protocol/ftp/package-tree.html | 12 +-
.../org/apache/nutch/protocol/ftp/package-use.html | 12 +-
.../protocol/htmlunit/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/htmlunit/HtmlUnitWebDriver.html | 12 +-
.../htmlunit/HtmlUnitWebWindowListener.html | 12 +-
.../org/apache/nutch/protocol/htmlunit/Http.html | 14 +-
.../protocol/htmlunit/HttpResponse.Scheme.html | 12 +-
.../nutch/protocol/htmlunit/HttpResponse.html | 14 +-
.../htmlunit/class-use/DummyX509TrustManager.html | 12 +-
.../htmlunit/class-use/HtmlUnitWebDriver.html | 12 +-
.../class-use/HtmlUnitWebWindowListener.html | 12 +-
.../nutch/protocol/htmlunit/class-use/Http.html | 12 +-
.../htmlunit/class-use/HttpResponse.Scheme.html | 12 +-
.../protocol/htmlunit/class-use/HttpResponse.html | 12 +-
.../nutch/protocol/htmlunit/package-summary.html | 12 +-
.../nutch/protocol/htmlunit/package-tree.html | 12 +-
.../nutch/protocol/htmlunit/package-use.html | 12 +-
.../nutch/protocol/http/DummyX509TrustManager.html | 12 +-
.../api/org/apache/nutch/protocol/http/Http.html | 14 +-
.../nutch/protocol/http/HttpResponse.Scheme.html | 12 +-
.../apache/nutch/protocol/http/HttpResponse.html | 14 +-
.../nutch/protocol/http/api/BlockedException.html | 12 +-
.../apache/nutch/protocol/http/api/HttpBase.html | 45 +-
.../nutch/protocol/http/api/HttpException.html | 12 +-
.../protocol/http/api/HttpRobotRulesParser.html | 12 +-
.../http/api/class-use/BlockedException.html | 12 +-
.../protocol/http/api/class-use/HttpBase.html | 12 +-
.../protocol/http/api/class-use/HttpException.html | 12 +-
.../http/api/class-use/HttpRobotRulesParser.html | 12 +-
.../nutch/protocol/http/api/package-summary.html | 12 +-
.../nutch/protocol/http/api/package-tree.html | 12 +-
.../nutch/protocol/http/api/package-use.html | 12 +-
.../http/class-use/DummyX509TrustManager.html | 12 +-
.../apache/nutch/protocol/http/class-use/Http.html | 12 +-
.../http/class-use/HttpResponse.Scheme.html | 12 +-
.../protocol/http/class-use/HttpResponse.html | 12 +-
.../nutch/protocol/http/package-summary.html | 12 +-
.../apache/nutch/protocol/http/package-tree.html | 12 +-
.../apache/nutch/protocol/http/package-use.html | 12 +-
.../httpclient/DummySSLProtocolSocketFactory.html | 12 +-
.../protocol/httpclient/DummyX509TrustManager.html | 12 +-
.../org/apache/nutch/protocol/httpclient/Http.html | 14 +-
.../protocol/httpclient/HttpAuthentication.html | 12 +-
.../httpclient/HttpAuthenticationException.html | 12 +-
.../httpclient/HttpAuthenticationFactory.html | 12 +-
.../httpclient/HttpBasicAuthentication.html | 12 +-
.../httpclient/HttpFormAuthConfigurer.html | 12 +-
.../httpclient/HttpFormAuthentication.html | 12 +-
.../nutch/protocol/httpclient/HttpResponse.html | 14 +-
.../class-use/DummySSLProtocolSocketFactory.html | 12 +-
.../class-use/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/httpclient/class-use/Http.html | 12 +-
.../httpclient/class-use/HttpAuthentication.html | 12 +-
.../class-use/HttpAuthenticationException.html | 12 +-
.../class-use/HttpAuthenticationFactory.html | 12 +-
.../class-use/HttpBasicAuthentication.html | 12 +-
.../class-use/HttpFormAuthConfigurer.html | 12 +-
.../class-use/HttpFormAuthentication.html | 12 +-
.../httpclient/class-use/HttpResponse.html | 12 +-
.../nutch/protocol/httpclient/package-summary.html | 12 +-
.../nutch/protocol/httpclient/package-tree.html | 12 +-
.../nutch/protocol/httpclient/package-use.html | 12 +-
.../interactiveselenium/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/interactiveselenium/Http.html | 14 +-
.../interactiveselenium/HttpResponse.Scheme.html | 12 +-
.../protocol/interactiveselenium/HttpResponse.html | 14 +-
.../class-use/DummyX509TrustManager.html | 12 +-
.../interactiveselenium/class-use/Http.html | 12 +-
.../class-use/HttpResponse.Scheme.html | 12 +-
.../class-use/HttpResponse.html | 12 +-
.../handlers/DefalultMultiInteractionHandler.html | 12 +-
.../handlers/DefaultClickAllAjaxLinksHandler.html | 12 +-
.../handlers/DefaultHandler.html | 12 +-
.../handlers/InteractiveSeleniumHandler.html | 12 +-
.../class-use/DefalultMultiInteractionHandler.html | 12 +-
.../class-use/DefaultClickAllAjaxLinksHandler.html | 12 +-
.../handlers/class-use/DefaultHandler.html | 12 +-
.../class-use/InteractiveSeleniumHandler.html | 12 +-
.../handlers/package-summary.html | 12 +-
.../interactiveselenium/handlers/package-tree.html | 12 +-
.../interactiveselenium/handlers/package-use.html | 12 +-
.../interactiveselenium/package-summary.html | 12 +-
.../protocol/interactiveselenium/package-tree.html | 12 +-
.../protocol/interactiveselenium/package-use.html | 12 +-
.../api/org/apache/nutch/protocol/okhttp/CIDR.html | 12 +-
.../nutch/protocol/okhttp/IPFilterRules.html | 12 +-
.../org/apache/nutch/protocol/okhttp/OkHttp.html | 14 +-
.../okhttp/OkHttpResponse.TruncatedContent.html | 12 +-
.../nutch/protocol/okhttp/OkHttpResponse.html | 14 +-
.../nutch/protocol/okhttp/class-use/CIDR.html | 12 +-
.../protocol/okhttp/class-use/IPFilterRules.html | 12 +-
.../nutch/protocol/okhttp/class-use/OkHttp.html | 12 +-
.../class-use/OkHttpResponse.TruncatedContent.html | 12 +-
.../protocol/okhttp/class-use/OkHttpResponse.html | 12 +-
.../nutch/protocol/okhttp/package-summary.html | 12 +-
.../apache/nutch/protocol/okhttp/package-tree.html | 12 +-
.../apache/nutch/protocol/okhttp/package-use.html | 12 +-
.../org/apache/nutch/protocol/package-summary.html | 12 +-
.../org/apache/nutch/protocol/package-tree.html | 12 +-
.../api/org/apache/nutch/protocol/package-use.html | 12 +-
.../protocol/selenium/DummyX509TrustManager.html | 12 +-
.../org/apache/nutch/protocol/selenium/Http.html | 14 +-
.../protocol/selenium/HttpResponse.Scheme.html | 12 +-
.../nutch/protocol/selenium/HttpResponse.html | 14 +-
.../nutch/protocol/selenium/HttpWebClient.html | 12 +-
.../selenium/class-use/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/selenium/class-use/Http.html | 12 +-
.../selenium/class-use/HttpResponse.Scheme.html | 12 +-
.../protocol/selenium/class-use/HttpResponse.html | 12 +-
.../protocol/selenium/class-use/HttpWebClient.html | 12 +-
.../nutch/protocol/selenium/package-summary.html | 12 +-
.../nutch/protocol/selenium/package-tree.html | 12 +-
.../nutch/protocol/selenium/package-use.html | 12 +-
.../org/apache/nutch/publisher/NutchPublisher.html | 12 +-
.../apache/nutch/publisher/NutchPublishers.html | 12 +-
.../nutch/publisher/class-use/NutchPublisher.html | 12 +-
.../nutch/publisher/class-use/NutchPublishers.html | 12 +-
.../apache/nutch/publisher/package-summary.html | 12 +-
.../org/apache/nutch/publisher/package-tree.html | 12 +-
.../org/apache/nutch/publisher/package-use.html | 12 +-
.../publisher/rabbitmq/RabbitMQPublisherImpl.html | 12 +-
.../rabbitmq/class-use/RabbitMQPublisherImpl.html | 12 +-
.../nutch/publisher/rabbitmq/package-summary.html | 12 +-
.../nutch/publisher/rabbitmq/package-tree.html | 12 +-
.../nutch/publisher/rabbitmq/package-use.html | 12 +-
.../org/apache/nutch/rabbitmq/RabbitMQClient.html | 12 +-
.../org/apache/nutch/rabbitmq/RabbitMQMessage.html | 12 +-
.../nutch/rabbitmq/class-use/RabbitMQClient.html | 12 +-
.../nutch/rabbitmq/class-use/RabbitMQMessage.html | 12 +-
.../org/apache/nutch/rabbitmq/package-summary.html | 12 +-
.../org/apache/nutch/rabbitmq/package-tree.html | 12 +-
.../api/org/apache/nutch/rabbitmq/package-use.html | 12 +-
.../nutch/scoring/AbstractScoringFilter.html | 14 +-
.../org/apache/nutch/scoring/ScoringFilter.html | 14 +-
.../nutch/scoring/ScoringFilterException.html | 12 +-
.../org/apache/nutch/scoring/ScoringFilters.html | 12 +-
.../scoring/class-use/AbstractScoringFilter.html | 42 +-
.../nutch/scoring/class-use/ScoringFilter.html | 42 +-
.../scoring/class-use/ScoringFilterException.html | 46 +-
.../nutch/scoring/class-use/ScoringFilters.html | 12 +-
.../nutch/scoring/depth/DepthScoringFilter.html | 12 +-
.../depth/class-use/DepthScoringFilter.html | 12 +-
.../nutch/scoring/depth/package-summary.html | 12 +-
.../apache/nutch/scoring/depth/package-tree.html | 12 +-
.../apache/nutch/scoring/depth/package-use.html | 12 +-
.../scoring/link/LinkAnalysisScoringFilter.html | 12 +-
.../link/class-use/LinkAnalysisScoringFilter.html | 12 +-
.../apache/nutch/scoring/link/package-summary.html | 12 +-
.../apache/nutch/scoring/link/package-tree.html | 12 +-
.../org/apache/nutch/scoring/link/package-use.html | 12 +-
.../scoring/metadata/MetadataScoringFilter.html | 12 +-
.../metadata/class-use/MetadataScoringFilter.html | 12 +-
.../nutch/scoring/metadata/package-summary.html | 12 +-
.../nutch/scoring/metadata/package-tree.html | 12 +-
.../apache/nutch/scoring/metadata/package-use.html | 12 +-
.../nutch/scoring/opic/OPICScoringFilter.html | 12 +-
.../scoring/opic/class-use/OPICScoringFilter.html | 12 +-
.../apache/nutch/scoring/opic/package-summary.html | 12 +-
.../apache/nutch/scoring/opic/package-tree.html | 12 +-
.../org/apache/nutch/scoring/opic/package-use.html | 12 +-
.../nutch/scoring/orphan/OrphanScoringFilter.html | 12 +-
.../orphan/class-use/OrphanScoringFilter.html | 12 +-
.../nutch/scoring/orphan/package-summary.html | 12 +-
.../apache/nutch/scoring/orphan/package-tree.html | 12 +-
.../apache/nutch/scoring/orphan/package-use.html | 12 +-
.../org/apache/nutch/scoring/package-summary.html | 12 +-
.../api/org/apache/nutch/scoring/package-tree.html | 12 +-
.../api/org/apache/nutch/scoring/package-use.html | 47 +-
.../nutch/scoring/similarity/SimilarityModel.html | 12 +-
.../similarity/SimilarityScoringFilter.html | 12 +-
.../similarity/class-use/SimilarityModel.html | 12 +-
.../class-use/SimilarityScoringFilter.html | 12 +-
.../similarity/cosine/CosineSimilarity.html | 12 +-
.../nutch/scoring/similarity/cosine/DocVector.html | 12 +-
.../nutch/scoring/similarity/cosine/Model.html | 12 +-
.../cosine/class-use/CosineSimilarity.html | 12 +-
.../similarity/cosine/class-use/DocVector.html | 12 +-
.../scoring/similarity/cosine/class-use/Model.html | 12 +-
.../scoring/similarity/cosine/package-summary.html | 12 +-
.../scoring/similarity/cosine/package-tree.html | 12 +-
.../scoring/similarity/cosine/package-use.html | 12 +-
.../nutch/scoring/similarity/package-summary.html | 12 +-
.../nutch/scoring/similarity/package-tree.html | 12 +-
.../nutch/scoring/similarity/package-use.html | 12 +-
.../util/LuceneAnalyzerUtil.StemFilterType.html | 12 +-
.../similarity/util/LuceneAnalyzerUtil.html | 12 +-
.../util/LuceneTokenizer.TokenizerType.html | 12 +-
.../scoring/similarity/util/LuceneTokenizer.html | 12 +-
.../LuceneAnalyzerUtil.StemFilterType.html | 12 +-
.../util/class-use/LuceneAnalyzerUtil.html | 12 +-
.../class-use/LuceneTokenizer.TokenizerType.html | 12 +-
.../similarity/util/class-use/LuceneTokenizer.html | 12 +-
.../scoring/similarity/util/package-summary.html | 12 +-
.../scoring/similarity/util/package-tree.html | 12 +-
.../nutch/scoring/similarity/util/package-use.html | 12 +-
.../apache/nutch/scoring/tld/TLDScoringFilter.html | 399 ----------
.../scoring/tld/class-use/TLDScoringFilter.html | 150 ----
.../apache/nutch/scoring/tld/package-summary.html | 175 -----
.../org/apache/nutch/scoring/tld/package-tree.html | 169 -----
.../org/apache/nutch/scoring/tld/package-use.html | 150 ----
.../scoring/urlmeta/URLMetaScoringFilter.html | 12 +-
.../urlmeta/class-use/URLMetaScoringFilter.html | 12 +-
.../nutch/scoring/urlmeta/package-summary.html | 12 +-
.../apache/nutch/scoring/urlmeta/package-tree.html | 12 +-
.../apache/nutch/scoring/urlmeta/package-use.html | 12 +-
.../apache/nutch/scoring/webgraph/LinkDatum.html | 12 +-
.../webgraph/LinkDumper.Inverter.InvertMapper.html | 12 +-
.../LinkDumper.Inverter.InvertReducer.html | 12 +-
.../scoring/webgraph/LinkDumper.Inverter.html | 12 +-
.../scoring/webgraph/LinkDumper.LinkNode.html | 12 +-
.../scoring/webgraph/LinkDumper.LinkNodes.html | 12 +-
.../nutch/scoring/webgraph/LinkDumper.Merger.html | 12 +-
.../nutch/scoring/webgraph/LinkDumper.Reader.html | 14 +-
.../apache/nutch/scoring/webgraph/LinkDumper.html | 12 +-
.../apache/nutch/scoring/webgraph/LinkRank.html | 12 +-
.../org/apache/nutch/scoring/webgraph/Node.html | 12 +-
.../webgraph/NodeDumper.Dumper.DumperMapper.html | 12 +-
.../webgraph/NodeDumper.Dumper.DumperReducer.html | 12 +-
.../nutch/scoring/webgraph/NodeDumper.Dumper.html | 12 +-
.../webgraph/NodeDumper.Sorter.SorterMapper.html | 12 +-
.../webgraph/NodeDumper.Sorter.SorterReducer.html | 12 +-
.../nutch/scoring/webgraph/NodeDumper.Sorter.html | 12 +-
.../apache/nutch/scoring/webgraph/NodeDumper.html | 12 +-
.../apache/nutch/scoring/webgraph/NodeReader.html | 12 +-
.../webgraph/ScoreUpdater.ScoreUpdaterMapper.html | 12 +-
.../webgraph/ScoreUpdater.ScoreUpdaterReducer.html | 12 +-
.../nutch/scoring/webgraph/ScoreUpdater.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbMapper.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbReducer.html | 12 +-
.../nutch/scoring/webgraph/WebGraph.OutlinkDb.html | 12 +-
.../apache/nutch/scoring/webgraph/WebGraph.html | 12 +-
.../scoring/webgraph/class-use/LinkDatum.html | 12 +-
.../LinkDumper.Inverter.InvertMapper.html | 12 +-
.../LinkDumper.Inverter.InvertReducer.html | 12 +-
.../webgraph/class-use/LinkDumper.Inverter.html | 12 +-
.../webgraph/class-use/LinkDumper.LinkNode.html | 12 +-
.../webgraph/class-use/LinkDumper.LinkNodes.html | 12 +-
.../webgraph/class-use/LinkDumper.Merger.html | 12 +-
.../webgraph/class-use/LinkDumper.Reader.html | 12 +-
.../scoring/webgraph/class-use/LinkDumper.html | 12 +-
.../nutch/scoring/webgraph/class-use/LinkRank.html | 12 +-
.../nutch/scoring/webgraph/class-use/Node.html | 12 +-
.../class-use/NodeDumper.Dumper.DumperMapper.html | 12 +-
.../class-use/NodeDumper.Dumper.DumperReducer.html | 12 +-
.../webgraph/class-use/NodeDumper.Dumper.html | 12 +-
.../class-use/NodeDumper.Sorter.SorterMapper.html | 12 +-
.../class-use/NodeDumper.Sorter.SorterReducer.html | 12 +-
.../webgraph/class-use/NodeDumper.Sorter.html | 12 +-
.../scoring/webgraph/class-use/NodeDumper.html | 12 +-
.../scoring/webgraph/class-use/NodeReader.html | 12 +-
.../class-use/ScoreUpdater.ScoreUpdaterMapper.html | 12 +-
.../ScoreUpdater.ScoreUpdaterReducer.html | 12 +-
.../scoring/webgraph/class-use/ScoreUpdater.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbMapper.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbReducer.html | 12 +-
.../webgraph/class-use/WebGraph.OutlinkDb.html | 12 +-
.../nutch/scoring/webgraph/class-use/WebGraph.html | 12 +-
.../nutch/scoring/webgraph/package-summary.html | 12 +-
.../nutch/scoring/webgraph/package-tree.html | 12 +-
.../apache/nutch/scoring/webgraph/package-use.html | 12 +-
.../nutch/segment/ContentAsTextInputFormat.html | 12 +-
.../org/apache/nutch/segment/SegmentChecker.html | 12 +-
.../apache/nutch/segment/SegmentMergeFilter.html | 12 +-
.../apache/nutch/segment/SegmentMergeFilters.html | 12 +-
.../segment/SegmentMerger.ObjectInputFormat.html | 12 +-
.../segment/SegmentMerger.SegmentMergerMapper.html | 12 +-
.../SegmentMerger.SegmentMergerReducer.html | 12 +-
.../segment/SegmentMerger.SegmentOutputFormat.html | 12 +-
.../org/apache/nutch/segment/SegmentMerger.html | 12 +-
.../api/org/apache/nutch/segment/SegmentPart.html | 12 +-
.../segment/SegmentReader.InputCompatMapper.html | 12 +-
.../segment/SegmentReader.InputCompatReducer.html | 12 +-
.../segment/SegmentReader.SegmentReaderStats.html | 12 +-
.../segment/SegmentReader.TextOutputFormat.html | 12 +-
.../org/apache/nutch/segment/SegmentReader.html | 12 +-
.../class-use/ContentAsTextInputFormat.html | 12 +-
.../nutch/segment/class-use/SegmentChecker.html | 12 +-
.../segment/class-use/SegmentMergeFilter.html | 12 +-
.../segment/class-use/SegmentMergeFilters.html | 12 +-
.../class-use/SegmentMerger.ObjectInputFormat.html | 12 +-
.../SegmentMerger.SegmentMergerMapper.html | 12 +-
.../SegmentMerger.SegmentMergerReducer.html | 12 +-
.../SegmentMerger.SegmentOutputFormat.html | 12 +-
.../nutch/segment/class-use/SegmentMerger.html | 12 +-
.../nutch/segment/class-use/SegmentPart.html | 12 +-
.../class-use/SegmentReader.InputCompatMapper.html | 12 +-
.../SegmentReader.InputCompatReducer.html | 12 +-
.../SegmentReader.SegmentReaderStats.html | 12 +-
.../class-use/SegmentReader.TextOutputFormat.html | 12 +-
.../nutch/segment/class-use/SegmentReader.html | 12 +-
.../org/apache/nutch/segment/package-summary.html | 12 +-
.../api/org/apache/nutch/segment/package-tree.html | 12 +-
.../api/org/apache/nutch/segment/package-use.html | 12 +-
.../api/org/apache/nutch/service/ConfManager.html | 12 +-
.../apache/nutch/service/JobManager.JobType.html | 12 +-
.../api/org/apache/nutch/service/JobManager.html | 12 +-
.../api/org/apache/nutch/service/NutchReader.html | 36 +-
.../api/org/apache/nutch/service/NutchServer.html | 12 +-
.../api/org/apache/nutch/service/SeedManager.html | 12 +-
.../nutch/service/class-use/ConfManager.html | 12 +-
.../service/class-use/JobManager.JobType.html | 12 +-
.../apache/nutch/service/class-use/JobManager.html | 12 +-
.../nutch/service/class-use/NutchReader.html | 12 +-
.../nutch/service/class-use/NutchServer.html | 12 +-
.../nutch/service/class-use/SeedManager.html | 12 +-
.../apache/nutch/service/impl/ConfManagerImpl.html | 12 +-
.../org/apache/nutch/service/impl/JobFactory.html | 12 +-
.../apache/nutch/service/impl/JobManagerImpl.html | 12 +-
.../org/apache/nutch/service/impl/JobWorker.html | 12 +-
.../org/apache/nutch/service/impl/LinkReader.html | 36 +-
.../org/apache/nutch/service/impl/NodeReader.html | 36 +-
.../service/impl/NutchServerPoolExecutor.html | 12 +-
.../apache/nutch/service/impl/SeedManagerImpl.html | 12 +-
.../apache/nutch/service/impl/SequenceReader.html | 12 +-
.../apache/nutch/service/impl/ServiceWorker.html | 12 +-
.../service/impl/class-use/ConfManagerImpl.html | 12 +-
.../nutch/service/impl/class-use/JobFactory.html | 12 +-
.../service/impl/class-use/JobManagerImpl.html | 12 +-
.../nutch/service/impl/class-use/JobWorker.html | 12 +-
.../nutch/service/impl/class-use/LinkReader.html | 12 +-
.../nutch/service/impl/class-use/NodeReader.html | 12 +-
.../impl/class-use/NutchServerPoolExecutor.html | 12 +-
.../service/impl/class-use/SeedManagerImpl.html | 12 +-
.../service/impl/class-use/SequenceReader.html | 12 +-
.../service/impl/class-use/ServiceWorker.html | 12 +-
.../apache/nutch/service/impl/package-summary.html | 12 +-
.../apache/nutch/service/impl/package-tree.html | 12 +-
.../org/apache/nutch/service/impl/package-use.html | 12 +-
.../nutch/service/model/request/DbQuery.html | 12 +-
.../nutch/service/model/request/JobConfig.html | 12 +-
.../nutch/service/model/request/NutchConfig.html | 12 +-
.../nutch/service/model/request/ReaderConfig.html | 12 +-
.../nutch/service/model/request/SeedList.html | 12 +-
.../nutch/service/model/request/SeedUrl.html | 12 +-
.../nutch/service/model/request/ServiceConfig.html | 12 +-
.../service/model/request/class-use/DbQuery.html | 12 +-
.../service/model/request/class-use/JobConfig.html | 12 +-
.../model/request/class-use/NutchConfig.html | 12 +-
.../model/request/class-use/ReaderConfig.html | 12 +-
.../service/model/request/class-use/SeedList.html | 12 +-
.../service/model/request/class-use/SeedUrl.html | 12 +-
.../model/request/class-use/ServiceConfig.html | 12 +-
.../service/model/request/package-summary.html | 12 +-
.../nutch/service/model/request/package-tree.html | 12 +-
.../nutch/service/model/request/package-use.html | 12 +-
.../service/model/response/FetchNodeDbInfo.html | 12 +-
.../service/model/response/JobInfo.State.html | 12 +-
.../nutch/service/model/response/JobInfo.html | 12 +-
.../service/model/response/NutchServerInfo.html | 12 +-
.../nutch/service/model/response/ServiceInfo.html | 12 +-
.../model/response/class-use/FetchNodeDbInfo.html | 12 +-
.../model/response/class-use/JobInfo.State.html | 12 +-
.../service/model/response/class-use/JobInfo.html | 12 +-
.../model/response/class-use/NutchServerInfo.html | 12 +-
.../model/response/class-use/ServiceInfo.html | 12 +-
.../service/model/response/package-summary.html | 12 +-
.../nutch/service/model/response/package-tree.html | 12 +-
.../nutch/service/model/response/package-use.html | 12 +-
.../org/apache/nutch/service/package-summary.html | 12 +-
.../api/org/apache/nutch/service/package-tree.html | 12 +-
.../api/org/apache/nutch/service/package-use.html | 12 +-
.../nutch/service/resources/AbstractResource.html | 12 +-
.../nutch/service/resources/AdminResource.html | 12 +-
.../nutch/service/resources/ConfigResource.html | 12 +-
.../apache/nutch/service/resources/DbResource.html | 12 +-
.../nutch/service/resources/JobResource.html | 12 +-
.../nutch/service/resources/ReaderResouce.html | 12 +-
.../nutch/service/resources/SeedResource.html | 12 +-
.../nutch/service/resources/ServicesResource.html | 12 +-
.../resources/class-use/AbstractResource.html | 12 +-
.../service/resources/class-use/AdminResource.html | 12 +-
.../resources/class-use/ConfigResource.html | 12 +-
.../service/resources/class-use/DbResource.html | 12 +-
.../service/resources/class-use/JobResource.html | 12 +-
.../service/resources/class-use/ReaderResouce.html | 12 +-
.../service/resources/class-use/SeedResource.html | 12 +-
.../resources/class-use/ServicesResource.html | 12 +-
.../nutch/service/resources/package-summary.html | 12 +-
.../nutch/service/resources/package-tree.html | 12 +-
.../nutch/service/resources/package-use.html | 12 +-
.../nutch/tools/AbstractCommonCrawlFormat.html | 12 +-
.../org/apache/nutch/tools/CommonCrawlConfig.html | 12 +-
.../apache/nutch/tools/CommonCrawlDataDumper.html | 12 +-
.../org/apache/nutch/tools/CommonCrawlFormat.html | 12 +-
.../nutch/tools/CommonCrawlFormatFactory.html | 12 +-
.../nutch/tools/CommonCrawlFormatJackson.html | 12 +-
.../nutch/tools/CommonCrawlFormatJettinson.html | 12 +-
.../nutch/tools/CommonCrawlFormatSimple.html | 12 +-
.../apache/nutch/tools/CommonCrawlFormatWARC.html | 12 +-
.../api/org/apache/nutch/tools/DmozParser.html | 12 +-
.../api/org/apache/nutch/tools/FileDumper.html | 12 +-
.../nutch/tools/FreeGenerator.FG.FGMapper.html | 12 +-
.../nutch/tools/FreeGenerator.FG.FGReducer.html | 12 +-
.../org/apache/nutch/tools/FreeGenerator.FG.html | 12 +-
.../api/org/apache/nutch/tools/FreeGenerator.html | 12 +-
.../api/org/apache/nutch/tools/ResolveUrls.html | 12 +-
.../api/org/apache/nutch/tools/ShowProperties.html | 12 +-
.../api/org/apache/nutch/tools/WARCUtils.html | 12 +-
.../org/apache/nutch/tools/arc/ArcInputFormat.html | 12 +-
.../apache/nutch/tools/arc/ArcRecordReader.html | 12 +-
.../ArcSegmentCreator.ArcSegmentCreatorMapper.html | 12 +-
.../apache/nutch/tools/arc/ArcSegmentCreator.html | 12 +-
.../nutch/tools/arc/class-use/ArcInputFormat.html | 12 +-
.../nutch/tools/arc/class-use/ArcRecordReader.html | 12 +-
.../ArcSegmentCreator.ArcSegmentCreatorMapper.html | 12 +-
.../tools/arc/class-use/ArcSegmentCreator.html | 12 +-
.../apache/nutch/tools/arc/package-summary.html | 12 +-
.../org/apache/nutch/tools/arc/package-tree.html | 12 +-
.../org/apache/nutch/tools/arc/package-use.html | 12 +-
.../tools/class-use/AbstractCommonCrawlFormat.html | 12 +-
.../nutch/tools/class-use/CommonCrawlConfig.html | 12 +-
.../tools/class-use/CommonCrawlDataDumper.html | 12 +-
.../nutch/tools/class-use/CommonCrawlFormat.html | 12 +-
.../tools/class-use/CommonCrawlFormatFactory.html | 12 +-
.../tools/class-use/CommonCrawlFormatJackson.html | 12 +-
.../class-use/CommonCrawlFormatJettinson.html | 12 +-
.../tools/class-use/CommonCrawlFormatSimple.html | 12 +-
.../tools/class-use/CommonCrawlFormatWARC.html | 12 +-
.../apache/nutch/tools/class-use/DmozParser.html | 12 +-
.../apache/nutch/tools/class-use/FileDumper.html | 12 +-
.../tools/class-use/FreeGenerator.FG.FGMapper.html | 12 +-
.../class-use/FreeGenerator.FG.FGReducer.html | 12 +-
.../nutch/tools/class-use/FreeGenerator.FG.html | 12 +-
.../nutch/tools/class-use/FreeGenerator.html | 12 +-
.../apache/nutch/tools/class-use/ResolveUrls.html | 12 +-
.../nutch/tools/class-use/ShowProperties.html | 12 +-
.../apache/nutch/tools/class-use/WARCUtils.html | 12 +-
.../org/apache/nutch/tools/package-summary.html | 12 +-
.../api/org/apache/nutch/tools/package-tree.html | 12 +-
.../api/org/apache/nutch/tools/package-use.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCMapper.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCReducer.html | 12 +-
.../tools/warc/WARCExporter.WARCMapReduce.html | 12 +-
.../org/apache/nutch/tools/warc/WARCExporter.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCMapper.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCReducer.html | 12 +-
.../warc/class-use/WARCExporter.WARCMapReduce.html | 12 +-
.../nutch/tools/warc/class-use/WARCExporter.html | 12 +-
.../apache/nutch/tools/warc/package-summary.html | 12 +-
.../org/apache/nutch/tools/warc/package-tree.html | 12 +-
.../org/apache/nutch/tools/warc/package-use.html | 12 +-
.../org/apache/nutch/urlfilter/api/RegexRule.html | 12 +-
.../nutch/urlfilter/api/RegexURLFilterBase.html | 18 +-
.../nutch/urlfilter/api/class-use/RegexRule.html | 12 +-
.../api/class-use/RegexURLFilterBase.html | 17 +-
.../nutch/urlfilter/api/package-summary.html | 12 +-
.../apache/nutch/urlfilter/api/package-tree.html | 12 +-
.../apache/nutch/urlfilter/api/package-use.html | 12 +-
.../urlfilter/automaton/AutomatonURLFilter.html | 14 +-
.../automaton/class-use/AutomatonURLFilter.html | 12 +-
.../nutch/urlfilter/automaton/package-summary.html | 12 +-
.../nutch/urlfilter/automaton/package-tree.html | 12 +-
.../nutch/urlfilter/automaton/package-use.html | 12 +-
.../nutch/urlfilter/domain/DomainURLFilter.html | 12 +-
.../domain/class-use/DomainURLFilter.html | 12 +-
.../nutch/urlfilter/domain/package-summary.html | 12 +-
.../nutch/urlfilter/domain/package-tree.html | 12 +-
.../apache/nutch/urlfilter/domain/package-use.html | 12 +-
.../domaindenylist/DomainDenylistURLFilter.html | 12 +-
.../class-use/DomainDenylistURLFilter.html | 12 +-
.../urlfilter/domaindenylist/package-summary.html | 12 +-
.../urlfilter/domaindenylist/package-tree.html | 12 +-
.../urlfilter/domaindenylist/package-use.html | 12 +-
.../urlfilter/fast/FastURLFilter.DenyAllRule.html | 12 +-
.../fast/FastURLFilter.DenyPathQueryRule.html | 12 +-
.../urlfilter/fast/FastURLFilter.DenyPathRule.html | 12 +-
.../nutch/urlfilter/fast/FastURLFilter.Rule.html | 12 +-
.../apache/nutch/urlfilter/fast/FastURLFilter.html | 12 +-
.../fast/class-use/FastURLFilter.DenyAllRule.html | 12 +-
.../class-use/FastURLFilter.DenyPathQueryRule.html | 12 +-
.../fast/class-use/FastURLFilter.DenyPathRule.html | 12 +-
.../fast/class-use/FastURLFilter.Rule.html | 12 +-
.../urlfilter/fast/class-use/FastURLFilter.html | 12 +-
.../nutch/urlfilter/fast/package-summary.html | 12 +-
.../apache/nutch/urlfilter/fast/package-tree.html | 12 +-
.../apache/nutch/urlfilter/fast/package-use.html | 12 +-
.../urlfilter/ignoreexempt/ExemptionUrlFilter.html | 35 +-
.../ignoreexempt/class-use/ExemptionUrlFilter.html | 12 +-
.../urlfilter/ignoreexempt/package-summary.html | 17 +-
.../nutch/urlfilter/ignoreexempt/package-tree.html | 12 +-
.../nutch/urlfilter/ignoreexempt/package-use.html | 12 +-
.../nutch/urlfilter/prefix/PrefixURLFilter.html | 12 +-
.../prefix/class-use/PrefixURLFilter.html | 12 +-
.../nutch/urlfilter/prefix/package-summary.html | 12 +-
.../nutch/urlfilter/prefix/package-tree.html | 12 +-
.../apache/nutch/urlfilter/prefix/package-use.html | 12 +-
.../nutch/urlfilter/regex/RegexURLFilter.html | 12 +-
.../urlfilter/regex/class-use/RegexURLFilter.html | 17 +-
.../nutch/urlfilter/regex/package-summary.html | 12 +-
.../apache/nutch/urlfilter/regex/package-tree.html | 12 +-
.../apache/nutch/urlfilter/regex/package-use.html | 12 +-
.../nutch/urlfilter/suffix/SuffixURLFilter.html | 12 +-
.../suffix/class-use/SuffixURLFilter.html | 12 +-
.../nutch/urlfilter/suffix/package-summary.html | 12 +-
.../nutch/urlfilter/suffix/package-tree.html | 12 +-
.../apache/nutch/urlfilter/suffix/package-use.html | 12 +-
.../nutch/urlfilter/validator/UrlValidator.html | 12 +-
.../validator/class-use/UrlValidator.html | 12 +-
.../nutch/urlfilter/validator/package-summary.html | 12 +-
.../nutch/urlfilter/validator/package-tree.html | 12 +-
.../nutch/urlfilter/validator/package-use.html | 12 +-
.../api/org/apache/nutch/util/AbstractChecker.html | 12 +-
.../api/org/apache/nutch/util/CommandRunner.html | 12 +-
...mpletionStats.CrawlCompletionStatsCombiner.html | 12 +-
.../apache/nutch/util/CrawlCompletionStats.html | 12 +-
.../api/org/apache/nutch/util/DeflateUtils.html | 12 +-
.../javadoc/api/org/apache/nutch/util/DomUtil.html | 12 +-
.../DomainStatistics.DomainStatisticsCombiner.html | 56 +-
.../{domain => }/DomainStatistics.MyCounter.html | 76 +-
.../nutch/util/{domain => }/DomainStatistics.html | 58 +-
.../api/org/apache/nutch/util/DumpFileUtil.html | 12 +-
.../org/apache/nutch/util/EncodingDetector.html | 12 +-
.../javadoc/api/org/apache/nutch/util/FSUtils.html | 12 +-
.../api/org/apache/nutch/util/GZIPUtils.html | 12 +-
.../nutch/util/GenericWritableConfigurable.html | 12 +-
.../api/org/apache/nutch/util/HadoopFSUtil.html | 12 +-
.../api/org/apache/nutch/util/JexlUtil.html | 12 +-
.../api/org/apache/nutch/util/LockUtil.html | 12 +-
.../api/org/apache/nutch/util/MimeUtil.html | 12 +-
.../api/org/apache/nutch/util/NodeWalker.html | 12 +-
.../org/apache/nutch/util/NutchConfiguration.html | 12 +-
.../api/org/apache/nutch/util/NutchJob.html | 12 +-
.../api/org/apache/nutch/util/NutchTool.html | 12 +-
.../api/org/apache/nutch/util/ObjectCache.html | 12 +-
.../org/apache/nutch/util/PrefixStringMatcher.html | 12 +-
...tatistics.ProtocolStatusStatisticsCombiner.html | 12 +-
.../nutch/util/ProtocolStatusStatistics.html | 12 +-
.../org/apache/nutch/util/SegmentReaderUtil.html | 12 +-
.../org/apache/nutch/util/SitemapProcessor.html | 12 +-
.../api/org/apache/nutch/util/StringUtil.html | 12 +-
.../org/apache/nutch/util/SuffixStringMatcher.html | 12 +-
.../api/org/apache/nutch/util/TableUtil.html | 12 +-
.../api/org/apache/nutch/util/TimingUtil.html | 12 +-
.../nutch/util/TrieStringMatcher.TrieNode.html | 12 +-
.../org/apache/nutch/util/TrieStringMatcher.html | 14 +-
.../javadoc/api/org/apache/nutch/util/URLUtil.html | 176 +++--
.../nutch/util/class-use/AbstractChecker.html | 12 +-
.../apache/nutch/util/class-use/CommandRunner.html | 12 +-
...mpletionStats.CrawlCompletionStatsCombiner.html | 12 +-
.../nutch/util/class-use/CrawlCompletionStats.html | 12 +-
.../apache/nutch/util/class-use/DeflateUtils.html | 12 +-
.../org/apache/nutch/util/class-use/DomUtil.html | 12 +-
...DomainStatistics.DomainStatisticsCombiner.html} | 20 +-
...tCache.html => DomainStatistics.MyCounter.html} | 40 +-
...EncodingDetector.html => DomainStatistics.html} | 20 +-
.../apache/nutch/util/class-use/DumpFileUtil.html | 12 +-
.../nutch/util/class-use/EncodingDetector.html | 12 +-
.../org/apache/nutch/util/class-use/FSUtils.html | 12 +-
.../org/apache/nutch/util/class-use/GZIPUtils.html | 12 +-
.../class-use/GenericWritableConfigurable.html | 12 +-
.../apache/nutch/util/class-use/HadoopFSUtil.html | 12 +-
.../org/apache/nutch/util/class-use/JexlUtil.html | 12 +-
.../org/apache/nutch/util/class-use/LockUtil.html | 12 +-
.../org/apache/nutch/util/class-use/MimeUtil.html | 12 +-
.../apache/nutch/util/class-use/NodeWalker.html | 12 +-
.../nutch/util/class-use/NutchConfiguration.html | 12 +-
.../org/apache/nutch/util/class-use/NutchJob.html | 12 +-
.../org/apache/nutch/util/class-use/NutchTool.html | 14 +-
.../apache/nutch/util/class-use/ObjectCache.html | 12 +-
.../nutch/util/class-use/PrefixStringMatcher.html | 12 +-
...tatistics.ProtocolStatusStatisticsCombiner.html | 12 +-
.../util/class-use/ProtocolStatusStatistics.html | 12 +-
.../nutch/util/class-use/SegmentReaderUtil.html | 12 +-
.../nutch/util/class-use/SitemapProcessor.html | 12 +-
.../apache/nutch/util/class-use/StringUtil.html | 12 +-
.../nutch/util/class-use/SuffixStringMatcher.html | 12 +-
.../org/apache/nutch/util/class-use/TableUtil.html | 12 +-
.../apache/nutch/util/class-use/TimingUtil.html | 12 +-
.../util/class-use/TrieStringMatcher.TrieNode.html | 12 +-
.../nutch/util/class-use/TrieStringMatcher.html | 12 +-
.../org/apache/nutch/util/class-use/URLUtil.html | 12 +-
.../nutch/util/domain/DomainSuffix.Status.html | 502 -------------
.../org/apache/nutch/util/domain/DomainSuffix.html | 478 ------------
.../apache/nutch/util/domain/DomainSuffixes.html | 331 --------
.../nutch/util/domain/TopLevelDomain.Type.html | 397 ----------
.../apache/nutch/util/domain/TopLevelDomain.html | 425 -----------
.../DomainStatistics.DomainStatisticsCombiner.html | 150 ----
.../class-use/DomainStatistics.MyCounter.html | 206 -----
.../util/domain/class-use/DomainStatistics.html | 150 ----
.../util/domain/class-use/DomainSuffix.Status.html | 255 -------
.../nutch/util/domain/class-use/DomainSuffix.html | 258 -------
.../util/domain/class-use/DomainSuffixes.html | 198 -----
.../util/domain/class-use/TopLevelDomain.Type.html | 227 ------
.../util/domain/class-use/TopLevelDomain.html | 150 ----
.../apache/nutch/util/domain/package-summary.html | 233 ------
.../org/apache/nutch/util/domain/package-tree.html | 196 -----
.../org/apache/nutch/util/domain/package-use.html | 237 ------
.../api/org/apache/nutch/util/package-summary.html | 37 +-
.../api/org/apache/nutch/util/package-tree.html | 28 +-
.../api/org/apache/nutch/util/package-use.html | 20 +-
.../creativecommons/nutch/CCIndexingFilter.html | 12 +-
.../nutch/CCParseFilter.Walker.html | 12 +-
.../org/creativecommons/nutch/CCParseFilter.html | 12 +-
.../nutch/class-use/CCIndexingFilter.html | 12 +-
.../nutch/class-use/CCParseFilter.Walker.html | 12 +-
.../nutch/class-use/CCParseFilter.html | 12 +-
.../org/creativecommons/nutch/package-summary.html | 12 +-
.../org/creativecommons/nutch/package-tree.html | 12 +-
.../api/org/creativecommons/nutch/package-use.html | 12 +-
.../javadoc/api/overview-summary.html | 4 +-
.../documentation/javadoc/api/overview-tree.html | 29 +-
.../javadoc/api/package-search-index.js | 2 +-
.../javadoc/api/package-search-index.zip | Bin 892 -> 884 bytes
.../javadoc/api/resources/nutch-default.xml | 58 +-
.../documentation/javadoc/api/serialized-form.html | 12 +-
.../documentation/javadoc/api/type-search-index.js | 2 +-
.../javadoc/api/type-search-index.zip | Bin 4268 -> 4220 bytes
content/news/nutch-1.18-release.md | 2 +-
content/news/nutch-1.19-release.md | 2 +-
content/news/nutch-1.20-release.md | 2 +-
...nutch-1.20-release.md => nutch-1.21-release.md} | 16 +-
layouts/_default/sitemap.xml | 9 +-
themes/kube/layouts/partials/footer.html | 2 +-
1317 files changed, 8921 insertions(+), 15048 deletions(-)
delete mode 100644 content/documentation/javadoc/api/jquery/jquery-3.6.1.min.js
create mode 100644 content/documentation/javadoc/api/jquery/jquery-3.7.1.min.js
delete mode 100644 content/documentation/javadoc/api/legal/ADDITIONAL_LICENSE_INFO
delete mode 100644 content/documentation/javadoc/api/legal/LICENSE
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/scoring/tld/TLDScoringFilter.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/scoring/tld/class-use/TLDScoringFilter.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/scoring/tld/package-summary.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/scoring/tld/package-tree.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/scoring/tld/package-use.html
rename content/documentation/javadoc/api/org/apache/nutch/util/{domain => }/DomainStatistics.DomainStatisticsCombiner.html (90%)
rename content/documentation/javadoc/api/org/apache/nutch/util/{domain => }/DomainStatistics.MyCounter.html (83%)
rename content/documentation/javadoc/api/org/apache/nutch/util/{domain => }/DomainStatistics.html (88%)
copy content/documentation/javadoc/api/org/apache/nutch/util/class-use/{CommandRunner.html => DomainStatistics.DomainStatisticsCombiner.html} (84%)
copy content/documentation/javadoc/api/org/apache/nutch/util/class-use/{ObjectCache.html => DomainStatistics.MyCounter.html} (68%)
copy content/documentation/javadoc/api/org/apache/nutch/util/class-use/{EncodingDetector.html => DomainStatistics.html} (87%)
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/DomainSuffix.Status.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/DomainSuffix.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/DomainSuffixes.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/TopLevelDomain.Type.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/TopLevelDomain.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/DomainStatistics.DomainStatisticsCombiner.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/DomainStatistics.MyCounter.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/DomainStatistics.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/DomainSuffix.Status.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/DomainSuffix.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/DomainSuffixes.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/TopLevelDomain.Type.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/class-use/TopLevelDomain.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/package-summary.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/package-tree.html
delete mode 100644 content/documentation/javadoc/api/org/apache/nutch/util/domain/package-use.html
copy content/news/{nutch-1.20-release.md => nutch-1.21-release.md} (62%)
(nutch-site) 02/04: Improve formatting of the sitemap.xml
Posted by sn...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
snagel pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nutch-site.git
commit 5a076b00b7237960caef02f30e5a512deebaf818
Author: Sebastian Nagel <sn...@apache.org>
AuthorDate: Sun Jul 20 19:41:25 2025 +0200
Improve formatting of the sitemap.xml
---
layouts/_default/sitemap.xml | 9 ++++-----
1 file changed, 4 insertions(+), 5 deletions(-)
diff --git a/layouts/_default/sitemap.xml b/layouts/_default/sitemap.xml
index 006e6ba..090be28 100644
--- a/layouts/_default/sitemap.xml
+++ b/layouts/_default/sitemap.xml
@@ -1,10 +1,9 @@
{{ printf "<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"yes\"?>" | safeHTML }}
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xhtml="http://www.w3.org/1999/xhtml">
- <url/>
{{ range .Data.Pages }}{{ if ne .Params.sitemapExclude true }}
- <url>{{ $url := urls.Parse .Permalink }}
- <loc>{{ .Site.Params.SiteBaseURL }}{{ $url.Path }}</loc>{{ if not .Lastmod.IsZero }}
- <lastmod>{{ safeHTML ( .Lastmod.Format "2006-01-02T15:04:05-07:00" ) }}</lastmod>{{ end }}
- </url>{{ end }}{{ end }}
+ <url>{{ $url := urls.Parse .Permalink }}
+ <loc>{{ .Site.Params.SiteBaseURL }}{{ $url.Path }}</loc>{{ if not .Lastmod.IsZero }}
+ <lastmod>{{ safeHTML ( .Lastmod.Format "2006-01-02T15:04:05-07:00" ) }}</lastmod>{{ end }}
+ </url>{{ end }}{{ end }}
</urlset>
(nutch-site) 04/04: Update site for release of Nutch 1.21
Posted by sn...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
snagel pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nutch-site.git
commit c7347ebe4f6b22721cd60231d36e8e6604a17db8
Author: Sebastian Nagel <sn...@apache.org>
AuthorDate: Sun Jul 20 20:40:43 2025 +0200
Update site for release of Nutch 1.21
---
README.md | 1 +
config.toml | 2 +-
content/doap.rdf | 7 +
.../javadoc/api/allclasses-index.html | 831 ++++++++++-----------
content/documentation/javadoc/api/allclasses.html | 20 +-
.../javadoc/api/allpackages-index.html | 66 +-
.../documentation/javadoc/api/constant-values.html | 58 +-
.../documentation/javadoc/api/deprecated-list.html | 21 +-
content/documentation/javadoc/api/element-list | 2 -
content/documentation/javadoc/api/help-doc.html | 12 +-
content/documentation/javadoc/api/index-all.html | 254 ++-----
content/documentation/javadoc/api/index.html | 72 +-
.../javadoc/api/jquery/jquery-3.6.1.min.js | 2 -
.../javadoc/api/jquery/jquery-3.7.1.min.js | 2 +
.../javadoc/api/legal/ADDITIONAL_LICENSE_INFO | 37 -
content/documentation/javadoc/api/legal/LICENSE | 347 ---------
content/documentation/javadoc/api/legal/jquery.md | 50 +-
.../javadoc/api/member-search-index.js | 2 +-
.../javadoc/api/member-search-index.zip | Bin 40541 -> 40145 bytes
.../nutch/analysis/lang/HTMLLanguageParser.html | 12 +-
.../analysis/lang/LanguageIndexingFilter.html | 12 +-
.../lang/class-use/HTMLLanguageParser.html | 12 +-
.../lang/class-use/LanguageIndexingFilter.html | 12 +-
.../nutch/analysis/lang/package-summary.html | 12 +-
.../apache/nutch/analysis/lang/package-tree.html | 12 +-
.../apache/nutch/analysis/lang/package-use.html | 12 +-
.../apache/nutch/collection/CollectionManager.html | 16 +-
.../org/apache/nutch/collection/Subcollection.html | 12 +-
.../collection/class-use/CollectionManager.html | 12 +-
.../nutch/collection/class-use/Subcollection.html | 19 +-
.../apache/nutch/collection/package-summary.html | 12 +-
.../org/apache/nutch/collection/package-tree.html | 12 +-
.../org/apache/nutch/collection/package-use.html | 12 +-
.../apache/nutch/crawl/AbstractFetchSchedule.html | 12 +-
.../apache/nutch/crawl/AdaptiveFetchSchedule.html | 72 +-
.../apache/nutch/crawl/CrawlDatum.Comparator.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDatum.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDb.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbFilter.html | 12 +-
.../apache/nutch/crawl/CrawlDbMerger.Merger.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbMerger.html | 12 +-
...CrawlDatumCsvOutputFormat.LineRecordWriter.html | 12 +-
.../CrawlDbReader.CrawlDatumCsvOutputFormat.html | 12 +-
...rawlDatumJsonOutputFormat.LineRecordWriter.html | 12 +-
...wlDatumJsonOutputFormat.WritableSerializer.html | 12 +-
.../CrawlDbReader.CrawlDatumJsonOutputFormat.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbDumpMapper.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbStatMapper.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbStatReducer.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbTopNMapper.html | 12 +-
.../crawl/CrawlDbReader.CrawlDbTopNReducer.html | 12 +-
.../nutch/crawl/CrawlDbReader.JsonIndenter.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbReader.html | 12 +-
.../api/org/apache/nutch/crawl/CrawlDbReducer.html | 12 +-
.../nutch/crawl/DeduplicationJob.DBFilter.html | 12 +-
.../nutch/crawl/DeduplicationJob.DedupReducer.html | 12 +-
.../DeduplicationJob.StatusUpdateReducer.html | 12 +-
.../org/apache/nutch/crawl/DeduplicationJob.html | 12 +-
.../apache/nutch/crawl/DefaultFetchSchedule.html | 12 +-
.../api/org/apache/nutch/crawl/FetchSchedule.html | 12 +-
.../apache/nutch/crawl/FetchScheduleFactory.html | 12 +-
...nerator.CrawlDbUpdater.CrawlDbUpdateMapper.html | 12 +-
...erator.CrawlDbUpdater.CrawlDbUpdateReducer.html | 12 +-
.../nutch/crawl/Generator.CrawlDbUpdater.html | 12 +-
.../crawl/Generator.DecreasingFloatComparator.html | 12 +-
.../nutch/crawl/Generator.HashComparator.html | 12 +-
.../nutch/crawl/Generator.PartitionReducer.html | 12 +-
.../org/apache/nutch/crawl/Generator.Selector.html | 12 +-
.../nutch/crawl/Generator.SelectorEntry.html | 12 +-
.../crawl/Generator.SelectorInverseMapper.html | 12 +-
.../nutch/crawl/Generator.SelectorMapper.html | 12 +-
.../nutch/crawl/Generator.SelectorReducer.html | 12 +-
.../api/org/apache/nutch/crawl/Generator.html | 98 ++-
.../apache/nutch/crawl/Injector.InjectMapper.html | 12 +-
.../apache/nutch/crawl/Injector.InjectReducer.html | 12 +-
.../api/org/apache/nutch/crawl/Injector.html | 12 +-
.../javadoc/api/org/apache/nutch/crawl/Inlink.html | 52 +-
.../api/org/apache/nutch/crawl/Inlinks.html | 12 +-
.../apache/nutch/crawl/LinkDb.LinkDbMapper.html | 12 +-
.../javadoc/api/org/apache/nutch/crawl/LinkDb.html | 12 +-
.../api/org/apache/nutch/crawl/LinkDbFilter.html | 12 +-
.../crawl/LinkDbMerger.LinkDbMergeReducer.html | 12 +-
.../api/org/apache/nutch/crawl/LinkDbMerger.html | 12 +-
.../nutch/crawl/LinkDbReader.LinkDBDumpMapper.html | 12 +-
.../api/org/apache/nutch/crawl/LinkDbReader.html | 12 +-
.../api/org/apache/nutch/crawl/MD5Signature.html | 12 +-
.../nutch/crawl/MimeAdaptiveFetchSchedule.html | 14 +-
.../api/org/apache/nutch/crawl/NutchWritable.html | 12 +-
.../api/org/apache/nutch/crawl/Signature.html | 12 +-
.../apache/nutch/crawl/SignatureComparator.html | 12 +-
.../org/apache/nutch/crawl/SignatureFactory.html | 12 +-
.../org/apache/nutch/crawl/TextMD5Signature.html | 12 +-
.../apache/nutch/crawl/TextProfileSignature.html | 12 +-
.../api/org/apache/nutch/crawl/URLPartitioner.html | 12 +-
.../crawl/class-use/AbstractFetchSchedule.html | 12 +-
.../crawl/class-use/AdaptiveFetchSchedule.html | 12 +-
.../crawl/class-use/CrawlDatum.Comparator.html | 12 +-
.../apache/nutch/crawl/class-use/CrawlDatum.html | 52 +-
.../org/apache/nutch/crawl/class-use/CrawlDb.html | 12 +-
.../nutch/crawl/class-use/CrawlDbFilter.html | 12 +-
.../crawl/class-use/CrawlDbMerger.Merger.html | 12 +-
.../nutch/crawl/class-use/CrawlDbMerger.html | 12 +-
...CrawlDatumCsvOutputFormat.LineRecordWriter.html | 12 +-
.../CrawlDbReader.CrawlDatumCsvOutputFormat.html | 12 +-
...rawlDatumJsonOutputFormat.LineRecordWriter.html | 12 +-
...wlDatumJsonOutputFormat.WritableSerializer.html | 12 +-
.../CrawlDbReader.CrawlDatumJsonOutputFormat.html | 12 +-
.../class-use/CrawlDbReader.CrawlDbDumpMapper.html | 12 +-
.../class-use/CrawlDbReader.CrawlDbStatMapper.html | 12 +-
.../CrawlDbReader.CrawlDbStatReducer.html | 12 +-
.../class-use/CrawlDbReader.CrawlDbTopNMapper.html | 12 +-
.../CrawlDbReader.CrawlDbTopNReducer.html | 12 +-
.../class-use/CrawlDbReader.JsonIndenter.html | 12 +-
.../nutch/crawl/class-use/CrawlDbReader.html | 12 +-
.../nutch/crawl/class-use/CrawlDbReducer.html | 12 +-
.../crawl/class-use/DeduplicationJob.DBFilter.html | 12 +-
.../class-use/DeduplicationJob.DedupReducer.html | 12 +-
.../DeduplicationJob.StatusUpdateReducer.html | 12 +-
.../nutch/crawl/class-use/DeduplicationJob.html | 12 +-
.../crawl/class-use/DefaultFetchSchedule.html | 12 +-
.../nutch/crawl/class-use/FetchSchedule.html | 12 +-
.../crawl/class-use/FetchScheduleFactory.html | 12 +-
...nerator.CrawlDbUpdater.CrawlDbUpdateMapper.html | 12 +-
...erator.CrawlDbUpdater.CrawlDbUpdateReducer.html | 12 +-
.../crawl/class-use/Generator.CrawlDbUpdater.html | 12 +-
.../Generator.DecreasingFloatComparator.html | 12 +-
.../crawl/class-use/Generator.HashComparator.html | 12 +-
.../class-use/Generator.PartitionReducer.html | 12 +-
.../nutch/crawl/class-use/Generator.Selector.html | 12 +-
.../crawl/class-use/Generator.SelectorEntry.html | 12 +-
.../class-use/Generator.SelectorInverseMapper.html | 12 +-
.../crawl/class-use/Generator.SelectorMapper.html | 12 +-
.../crawl/class-use/Generator.SelectorReducer.html | 12 +-
.../apache/nutch/crawl/class-use/Generator.html | 12 +-
.../crawl/class-use/Injector.InjectMapper.html | 12 +-
.../crawl/class-use/Injector.InjectReducer.html | 12 +-
.../org/apache/nutch/crawl/class-use/Injector.html | 12 +-
.../org/apache/nutch/crawl/class-use/Inlink.html | 12 +-
.../org/apache/nutch/crawl/class-use/Inlinks.html | 46 +-
.../nutch/crawl/class-use/LinkDb.LinkDbMapper.html | 12 +-
.../org/apache/nutch/crawl/class-use/LinkDb.html | 12 +-
.../apache/nutch/crawl/class-use/LinkDbFilter.html | 12 +-
.../class-use/LinkDbMerger.LinkDbMergeReducer.html | 12 +-
.../apache/nutch/crawl/class-use/LinkDbMerger.html | 12 +-
.../class-use/LinkDbReader.LinkDBDumpMapper.html | 12 +-
.../apache/nutch/crawl/class-use/LinkDbReader.html | 12 +-
.../apache/nutch/crawl/class-use/MD5Signature.html | 12 +-
.../crawl/class-use/MimeAdaptiveFetchSchedule.html | 12 +-
.../nutch/crawl/class-use/NutchWritable.html | 12 +-
.../apache/nutch/crawl/class-use/Signature.html | 12 +-
.../nutch/crawl/class-use/SignatureComparator.html | 12 +-
.../nutch/crawl/class-use/SignatureFactory.html | 12 +-
.../nutch/crawl/class-use/TextMD5Signature.html | 12 +-
.../crawl/class-use/TextProfileSignature.html | 12 +-
.../nutch/crawl/class-use/URLPartitioner.html | 12 +-
.../org/apache/nutch/crawl/package-summary.html | 14 +-
.../api/org/apache/nutch/crawl/package-tree.html | 12 +-
.../api/org/apache/nutch/crawl/package-use.html | 53 +-
.../api/org/apache/nutch/exchange/Exchange.html | 12 +-
.../org/apache/nutch/exchange/ExchangeConfig.html | 12 +-
.../api/org/apache/nutch/exchange/Exchanges.html | 12 +-
.../apache/nutch/exchange/class-use/Exchange.html | 12 +-
.../nutch/exchange/class-use/ExchangeConfig.html | 12 +-
.../apache/nutch/exchange/class-use/Exchanges.html | 12 +-
.../apache/nutch/exchange/jexl/JexlExchange.html | 12 +-
.../exchange/jexl/class-use/JexlExchange.html | 12 +-
.../nutch/exchange/jexl/package-summary.html | 12 +-
.../apache/nutch/exchange/jexl/package-tree.html | 12 +-
.../apache/nutch/exchange/jexl/package-use.html | 12 +-
.../org/apache/nutch/exchange/package-summary.html | 12 +-
.../org/apache/nutch/exchange/package-tree.html | 12 +-
.../api/org/apache/nutch/exchange/package-use.html | 12 +-
.../api/org/apache/nutch/fetcher/FetchItem.html | 12 +-
.../org/apache/nutch/fetcher/FetchItemQueue.html | 12 +-
.../org/apache/nutch/fetcher/FetchItemQueues.html | 40 +-
.../api/org/apache/nutch/fetcher/FetchNode.html | 12 +-
.../api/org/apache/nutch/fetcher/FetchNodeDb.html | 12 +-
.../apache/nutch/fetcher/Fetcher.FetcherRun.html | 12 +-
.../apache/nutch/fetcher/Fetcher.InputFormat.html | 12 +-
.../api/org/apache/nutch/fetcher/Fetcher.html | 22 +-
.../apache/nutch/fetcher/FetcherOutputFormat.html | 12 +-
.../org/apache/nutch/fetcher/FetcherThread.html | 12 +-
.../FetcherThreadEvent.PublishEventType.html | 12 +-
.../apache/nutch/fetcher/FetcherThreadEvent.html | 20 +-
.../nutch/fetcher/FetcherThreadPublisher.html | 12 +-
.../api/org/apache/nutch/fetcher/QueueFeeder.html | 28 +-
.../apache/nutch/fetcher/class-use/FetchItem.html | 12 +-
.../nutch/fetcher/class-use/FetchItemQueue.html | 12 +-
.../nutch/fetcher/class-use/FetchItemQueues.html | 12 +-
.../apache/nutch/fetcher/class-use/FetchNode.html | 12 +-
.../nutch/fetcher/class-use/FetchNodeDb.html | 12 +-
.../fetcher/class-use/Fetcher.FetcherRun.html | 12 +-
.../fetcher/class-use/Fetcher.InputFormat.html | 12 +-
.../apache/nutch/fetcher/class-use/Fetcher.html | 12 +-
.../fetcher/class-use/FetcherOutputFormat.html | 12 +-
.../nutch/fetcher/class-use/FetcherThread.html | 12 +-
.../FetcherThreadEvent.PublishEventType.html | 12 +-
.../fetcher/class-use/FetcherThreadEvent.html | 12 +-
.../fetcher/class-use/FetcherThreadPublisher.html | 12 +-
.../nutch/fetcher/class-use/QueueFeeder.html | 12 +-
.../org/apache/nutch/fetcher/package-summary.html | 12 +-
.../api/org/apache/nutch/fetcher/package-tree.html | 12 +-
.../api/org/apache/nutch/fetcher/package-use.html | 12 +-
.../apache/nutch/hostdb/CrawlDatumProcessor.html | 12 +-
.../hostdb/FetchOverdueCrawlDatumProcessor.html | 12 +-
.../api/org/apache/nutch/hostdb/HostDatum.html | 12 +-
.../api/org/apache/nutch/hostdb/ReadHostDb.html | 12 +-
.../org/apache/nutch/hostdb/ResolverThread.html | 12 +-
.../api/org/apache/nutch/hostdb/UpdateHostDb.html | 34 +-
.../apache/nutch/hostdb/UpdateHostDbMapper.html | 12 +-
.../apache/nutch/hostdb/UpdateHostDbReducer.html | 26 +-
.../hostdb/class-use/CrawlDatumProcessor.html | 12 +-
.../class-use/FetchOverdueCrawlDatumProcessor.html | 12 +-
.../apache/nutch/hostdb/class-use/HostDatum.html | 12 +-
.../apache/nutch/hostdb/class-use/ReadHostDb.html | 12 +-
.../nutch/hostdb/class-use/ResolverThread.html | 12 +-
.../nutch/hostdb/class-use/UpdateHostDb.html | 12 +-
.../nutch/hostdb/class-use/UpdateHostDbMapper.html | 12 +-
.../hostdb/class-use/UpdateHostDbReducer.html | 12 +-
.../org/apache/nutch/hostdb/package-summary.html | 12 +-
.../api/org/apache/nutch/hostdb/package-tree.html | 12 +-
.../api/org/apache/nutch/hostdb/package-use.html | 12 +-
.../apache/nutch/indexer/CleaningJob.DBFilter.html | 12 +-
.../nutch/indexer/CleaningJob.DeleterReducer.html | 12 +-
.../api/org/apache/nutch/indexer/CleaningJob.html | 12 +-
.../api/org/apache/nutch/indexer/IndexWriter.html | 12 +-
.../apache/nutch/indexer/IndexWriterConfig.html | 12 +-
.../apache/nutch/indexer/IndexWriterParams.html | 12 +-
.../indexer/IndexWriters.IndexWriterWrapper.html | 12 +-
.../api/org/apache/nutch/indexer/IndexWriters.html | 12 +-
.../indexer/IndexerMapReduce.IndexerMapper.html | 12 +-
.../indexer/IndexerMapReduce.IndexerReducer.html | 12 +-
.../org/apache/nutch/indexer/IndexerMapReduce.html | 12 +-
.../apache/nutch/indexer/IndexerOutputFormat.html | 12 +-
.../apache/nutch/indexer/IndexingException.html | 12 +-
.../org/apache/nutch/indexer/IndexingFilter.html | 12 +-
.../org/apache/nutch/indexer/IndexingFilters.html | 12 +-
.../nutch/indexer/IndexingFiltersChecker.html | 12 +-
.../api/org/apache/nutch/indexer/IndexingJob.html | 12 +-
.../org/apache/nutch/indexer/NutchDocument.html | 12 +-
.../api/org/apache/nutch/indexer/NutchField.html | 12 +-
.../org/apache/nutch/indexer/NutchIndexAction.html | 12 +-
.../nutch/indexer/anchor/AnchorIndexingFilter.html | 12 +-
.../anchor/class-use/AnchorIndexingFilter.html | 12 +-
.../nutch/indexer/anchor/package-summary.html | 12 +-
.../apache/nutch/indexer/anchor/package-tree.html | 12 +-
.../apache/nutch/indexer/anchor/package-use.html | 12 +-
.../indexer/arbitrary/ArbitraryIndexingFilter.html | 12 +-
.../class-use/ArbitraryIndexingFilter.html | 12 +-
.../nutch/indexer/arbitrary/package-summary.html | 12 +-
.../nutch/indexer/arbitrary/package-tree.html | 12 +-
.../nutch/indexer/arbitrary/package-use.html | 12 +-
.../nutch/indexer/basic/BasicIndexingFilter.html | 12 +-
.../basic/class-use/BasicIndexingFilter.html | 12 +-
.../nutch/indexer/basic/package-summary.html | 12 +-
.../apache/nutch/indexer/basic/package-tree.html | 12 +-
.../apache/nutch/indexer/basic/package-use.html | 12 +-
.../indexer/class-use/CleaningJob.DBFilter.html | 12 +-
.../class-use/CleaningJob.DeleterReducer.html | 12 +-
.../nutch/indexer/class-use/CleaningJob.html | 12 +-
.../nutch/indexer/class-use/IndexWriter.html | 12 +-
.../nutch/indexer/class-use/IndexWriterConfig.html | 12 +-
.../nutch/indexer/class-use/IndexWriterParams.html | 12 +-
.../class-use/IndexWriters.IndexWriterWrapper.html | 12 +-
.../nutch/indexer/class-use/IndexWriters.html | 12 +-
.../class-use/IndexerMapReduce.IndexerMapper.html | 12 +-
.../class-use/IndexerMapReduce.IndexerReducer.html | 12 +-
.../nutch/indexer/class-use/IndexerMapReduce.html | 12 +-
.../indexer/class-use/IndexerOutputFormat.html | 12 +-
.../nutch/indexer/class-use/IndexingException.html | 12 +-
.../nutch/indexer/class-use/IndexingFilter.html | 14 +-
.../nutch/indexer/class-use/IndexingFilters.html | 12 +-
.../indexer/class-use/IndexingFiltersChecker.html | 12 +-
.../nutch/indexer/class-use/IndexingJob.html | 12 +-
.../nutch/indexer/class-use/NutchDocument.html | 48 +-
.../apache/nutch/indexer/class-use/NutchField.html | 12 +-
.../nutch/indexer/class-use/NutchIndexAction.html | 12 +-
.../nutch/indexer/feed/FeedIndexingFilter.html | 12 +-
.../indexer/feed/class-use/FeedIndexingFilter.html | 12 +-
.../apache/nutch/indexer/feed/package-summary.html | 12 +-
.../apache/nutch/indexer/feed/package-tree.html | 12 +-
.../org/apache/nutch/indexer/feed/package-use.html | 12 +-
.../indexer/filter/MimeTypeIndexingFilter.html | 12 +-
.../filter/class-use/MimeTypeIndexingFilter.html | 12 +-
.../nutch/indexer/filter/package-summary.html | 12 +-
.../apache/nutch/indexer/filter/package-tree.html | 12 +-
.../apache/nutch/indexer/filter/package-use.html | 12 +-
.../nutch/indexer/geoip/GeoIPDocumentCreator.html | 12 +-
.../nutch/indexer/geoip/GeoIPIndexingFilter.html | 12 +-
.../geoip/class-use/GeoIPDocumentCreator.html | 12 +-
.../geoip/class-use/GeoIPIndexingFilter.html | 12 +-
.../nutch/indexer/geoip/package-summary.html | 12 +-
.../apache/nutch/indexer/geoip/package-tree.html | 12 +-
.../apache/nutch/indexer/geoip/package-use.html | 12 +-
.../nutch/indexer/jexl/JexlIndexingFilter.html | 12 +-
.../indexer/jexl/class-use/JexlIndexingFilter.html | 12 +-
.../apache/nutch/indexer/jexl/package-summary.html | 12 +-
.../apache/nutch/indexer/jexl/package-tree.html | 12 +-
.../org/apache/nutch/indexer/jexl/package-use.html | 12 +-
.../nutch/indexer/links/LinksIndexingFilter.html | 12 +-
.../links/class-use/LinksIndexingFilter.html | 12 +-
.../nutch/indexer/links/package-summary.html | 12 +-
.../apache/nutch/indexer/links/package-tree.html | 12 +-
.../apache/nutch/indexer/links/package-use.html | 12 +-
.../nutch/indexer/metadata/MetadataIndexer.html | 12 +-
.../metadata/class-use/MetadataIndexer.html | 12 +-
.../nutch/indexer/metadata/package-summary.html | 12 +-
.../nutch/indexer/metadata/package-tree.html | 12 +-
.../apache/nutch/indexer/metadata/package-use.html | 12 +-
.../nutch/indexer/more/MoreIndexingFilter.html | 12 +-
.../indexer/more/class-use/MoreIndexingFilter.html | 12 +-
.../apache/nutch/indexer/more/package-summary.html | 12 +-
.../apache/nutch/indexer/more/package-tree.html | 12 +-
.../org/apache/nutch/indexer/more/package-use.html | 12 +-
.../org/apache/nutch/indexer/package-summary.html | 12 +-
.../api/org/apache/nutch/indexer/package-tree.html | 12 +-
.../api/org/apache/nutch/indexer/package-use.html | 39 +-
.../nutch/indexer/replace/FieldReplacer.html | 12 +-
.../nutch/indexer/replace/ReplaceIndexer.html | 12 +-
.../indexer/replace/class-use/FieldReplacer.html | 12 +-
.../indexer/replace/class-use/ReplaceIndexer.html | 12 +-
.../nutch/indexer/replace/package-summary.html | 12 +-
.../apache/nutch/indexer/replace/package-tree.html | 12 +-
.../apache/nutch/indexer/replace/package-use.html | 12 +-
.../indexer/staticfield/StaticFieldIndexer.html | 12 +-
.../staticfield/class-use/StaticFieldIndexer.html | 12 +-
.../nutch/indexer/staticfield/package-summary.html | 12 +-
.../nutch/indexer/staticfield/package-tree.html | 12 +-
.../nutch/indexer/staticfield/package-use.html | 12 +-
.../subcollection/SubcollectionIndexingFilter.html | 12 +-
.../class-use/SubcollectionIndexingFilter.html | 12 +-
.../indexer/subcollection/package-summary.html | 12 +-
.../nutch/indexer/subcollection/package-tree.html | 12 +-
.../nutch/indexer/subcollection/package-use.html | 12 +-
.../nutch/indexer/tld/TLDIndexingFilter.html | 20 +-
.../indexer/tld/class-use/TLDIndexingFilter.html | 12 +-
.../apache/nutch/indexer/tld/package-summary.html | 14 +-
.../org/apache/nutch/indexer/tld/package-tree.html | 12 +-
.../org/apache/nutch/indexer/tld/package-use.html | 12 +-
.../indexer/urlmeta/URLMetaIndexingFilter.html | 12 +-
.../urlmeta/class-use/URLMetaIndexingFilter.html | 12 +-
.../nutch/indexer/urlmeta/package-summary.html | 12 +-
.../apache/nutch/indexer/urlmeta/package-tree.html | 12 +-
.../apache/nutch/indexer/urlmeta/package-use.html | 12 +-
.../cloudsearch/CloudSearchConstants.html | 12 +-
.../cloudsearch/CloudSearchIndexWriter.html | 12 +-
.../indexwriter/cloudsearch/CloudSearchUtils.html | 12 +-
.../class-use/CloudSearchConstants.html | 12 +-
.../class-use/CloudSearchIndexWriter.html | 12 +-
.../cloudsearch/class-use/CloudSearchUtils.html | 12 +-
.../indexwriter/cloudsearch/package-summary.html | 12 +-
.../indexwriter/cloudsearch/package-tree.html | 12 +-
.../nutch/indexwriter/cloudsearch/package-use.html | 12 +-
.../apache/nutch/indexwriter/csv/CSVConstants.html | 12 +-
.../indexwriter/csv/CSVIndexWriter.Separator.html | 12 +-
.../nutch/indexwriter/csv/CSVIndexWriter.html | 12 +-
.../indexwriter/csv/class-use/CSVConstants.html | 12 +-
.../csv/class-use/CSVIndexWriter.Separator.html | 12 +-
.../indexwriter/csv/class-use/CSVIndexWriter.html | 12 +-
.../nutch/indexwriter/csv/package-summary.html | 12 +-
.../apache/nutch/indexwriter/csv/package-tree.html | 12 +-
.../apache/nutch/indexwriter/csv/package-use.html | 12 +-
.../nutch/indexwriter/dummy/DummyConstants.html | 12 +-
.../nutch/indexwriter/dummy/DummyIndexWriter.html | 12 +-
.../dummy/class-use/DummyConstants.html | 12 +-
.../dummy/class-use/DummyIndexWriter.html | 12 +-
.../nutch/indexwriter/dummy/package-summary.html | 12 +-
.../nutch/indexwriter/dummy/package-tree.html | 12 +-
.../nutch/indexwriter/dummy/package-use.html | 12 +-
.../indexwriter/elastic/ElasticConstants.html | 12 +-
.../indexwriter/elastic/ElasticIndexWriter.html | 12 +-
.../elastic/class-use/ElasticConstants.html | 12 +-
.../elastic/class-use/ElasticIndexWriter.html | 12 +-
.../nutch/indexwriter/elastic/package-summary.html | 12 +-
.../nutch/indexwriter/elastic/package-tree.html | 12 +-
.../nutch/indexwriter/elastic/package-use.html | 12 +-
.../nutch/indexwriter/kafka/KafkaConstants.html | 12 +-
.../nutch/indexwriter/kafka/KafkaIndexWriter.html | 12 +-
.../kafka/class-use/KafkaConstants.html | 12 +-
.../kafka/class-use/KafkaIndexWriter.html | 12 +-
.../nutch/indexwriter/kafka/package-summary.html | 12 +-
.../nutch/indexwriter/kafka/package-tree.html | 12 +-
.../nutch/indexwriter/kafka/package-use.html | 12 +-
.../opensearch1x/OpenSearch1xConstants.html | 12 +-
.../opensearch1x/OpenSearch1xIndexWriter.html | 12 +-
.../class-use/OpenSearch1xConstants.html | 12 +-
.../class-use/OpenSearch1xIndexWriter.html | 12 +-
.../indexwriter/opensearch1x/package-summary.html | 12 +-
.../indexwriter/opensearch1x/package-tree.html | 12 +-
.../indexwriter/opensearch1x/package-use.html | 12 +-
.../indexwriter/rabbit/RabbitIndexWriter.html | 12 +-
.../rabbit/class-use/RabbitIndexWriter.html | 12 +-
.../nutch/indexwriter/rabbit/package-summary.html | 12 +-
.../nutch/indexwriter/rabbit/package-tree.html | 12 +-
.../nutch/indexwriter/rabbit/package-use.html | 12 +-
.../nutch/indexwriter/solr/SolrConstants.html | 12 +-
.../nutch/indexwriter/solr/SolrIndexWriter.html | 12 +-
.../apache/nutch/indexwriter/solr/SolrUtils.html | 12 +-
.../indexwriter/solr/class-use/SolrConstants.html | 12 +-
.../solr/class-use/SolrIndexWriter.html | 12 +-
.../indexwriter/solr/class-use/SolrUtils.html | 12 +-
.../nutch/indexwriter/solr/package-summary.html | 12 +-
.../nutch/indexwriter/solr/package-tree.html | 12 +-
.../apache/nutch/indexwriter/solr/package-use.html | 12 +-
.../nutch/metadata/CaseInsensitiveMetadata.html | 12 +-
.../org/apache/nutch/metadata/CreativeCommons.html | 12 +-
.../api/org/apache/nutch/metadata/DublinCore.html | 12 +-
.../api/org/apache/nutch/metadata/Feed.html | 12 +-
.../api/org/apache/nutch/metadata/HttpHeaders.html | 12 +-
.../api/org/apache/nutch/metadata/MetaWrapper.html | 12 +-
.../api/org/apache/nutch/metadata/Metadata.html | 12 +-
.../api/org/apache/nutch/metadata/Nutch.html | 12 +-
.../nutch/metadata/SpellCheckedMetadata.html | 12 +-
.../class-use/CaseInsensitiveMetadata.html | 12 +-
.../nutch/metadata/class-use/CreativeCommons.html | 12 +-
.../nutch/metadata/class-use/DublinCore.html | 12 +-
.../org/apache/nutch/metadata/class-use/Feed.html | 12 +-
.../nutch/metadata/class-use/HttpHeaders.html | 12 +-
.../nutch/metadata/class-use/MetaWrapper.html | 12 +-
.../apache/nutch/metadata/class-use/Metadata.html | 12 +-
.../org/apache/nutch/metadata/class-use/Nutch.html | 12 +-
.../metadata/class-use/SpellCheckedMetadata.html | 12 +-
.../org/apache/nutch/metadata/package-summary.html | 12 +-
.../org/apache/nutch/metadata/package-tree.html | 12 +-
.../api/org/apache/nutch/metadata/package-use.html | 12 +-
.../microformats/reltag/RelTagIndexingFilter.html | 12 +-
.../nutch/microformats/reltag/RelTagParser.html | 12 +-
.../reltag/class-use/RelTagIndexingFilter.html | 12 +-
.../reltag/class-use/RelTagParser.html | 12 +-
.../nutch/microformats/reltag/package-summary.html | 12 +-
.../nutch/microformats/reltag/package-tree.html | 12 +-
.../nutch/microformats/reltag/package-use.html | 12 +-
.../org/apache/nutch/net/URLExemptionFilter.html | 12 +-
.../org/apache/nutch/net/URLExemptionFilters.html | 12 +-
.../api/org/apache/nutch/net/URLFilter.html | 12 +-
.../api/org/apache/nutch/net/URLFilterChecker.html | 12 +-
.../org/apache/nutch/net/URLFilterException.html | 12 +-
.../api/org/apache/nutch/net/URLFilters.html | 12 +-
.../api/org/apache/nutch/net/URLNormalizer.html | 12 +-
.../org/apache/nutch/net/URLNormalizerChecker.html | 12 +-
.../api/org/apache/nutch/net/URLNormalizers.html | 12 +-
.../nutch/net/class-use/URLExemptionFilter.html | 17 +-
.../nutch/net/class-use/URLExemptionFilters.html | 12 +-
.../org/apache/nutch/net/class-use/URLFilter.html | 17 +-
.../nutch/net/class-use/URLFilterChecker.html | 12 +-
.../nutch/net/class-use/URLFilterException.html | 12 +-
.../org/apache/nutch/net/class-use/URLFilters.html | 12 +-
.../apache/nutch/net/class-use/URLNormalizer.html | 12 +-
.../nutch/net/class-use/URLNormalizerChecker.html | 12 +-
.../apache/nutch/net/class-use/URLNormalizers.html | 12 +-
.../api/org/apache/nutch/net/package-summary.html | 12 +-
.../api/org/apache/nutch/net/package-tree.html | 12 +-
.../api/org/apache/nutch/net/package-use.html | 12 +-
.../apache/nutch/net/protocols/HttpDateFormat.html | 12 +-
.../nutch/net/protocols/ProtocolException.html | 12 +-
.../nutch/net/protocols/ProtocolLogUtil.html | 12 +-
.../protocols/Response.TruncatedContentReason.html | 12 +-
.../org/apache/nutch/net/protocols/Response.html | 60 +-
.../net/protocols/class-use/HttpDateFormat.html | 12 +-
.../net/protocols/class-use/ProtocolException.html | 12 +-
.../net/protocols/class-use/ProtocolLogUtil.html | 12 +-
.../class-use/Response.TruncatedContentReason.html | 12 +-
.../nutch/net/protocols/class-use/Response.html | 12 +-
.../nutch/net/protocols/package-summary.html | 12 +-
.../apache/nutch/net/protocols/package-tree.html | 12 +-
.../apache/nutch/net/protocols/package-use.html | 12 +-
.../net/urlnormalizer/ajax/AjaxURLNormalizer.html | 12 +-
.../ajax/class-use/AjaxURLNormalizer.html | 12 +-
.../net/urlnormalizer/ajax/package-summary.html | 12 +-
.../nutch/net/urlnormalizer/ajax/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/ajax/package-use.html | 12 +-
.../urlnormalizer/basic/BasicURLNormalizer.html | 12 +-
.../basic/class-use/BasicURLNormalizer.html | 12 +-
.../net/urlnormalizer/basic/package-summary.html | 12 +-
.../net/urlnormalizer/basic/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/basic/package-use.html | 12 +-
.../net/urlnormalizer/host/HostURLNormalizer.html | 12 +-
.../host/class-use/HostURLNormalizer.html | 12 +-
.../net/urlnormalizer/host/package-summary.html | 12 +-
.../nutch/net/urlnormalizer/host/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/host/package-use.html | 12 +-
.../net/urlnormalizer/pass/PassURLNormalizer.html | 12 +-
.../pass/class-use/PassURLNormalizer.html | 12 +-
.../net/urlnormalizer/pass/package-summary.html | 12 +-
.../nutch/net/urlnormalizer/pass/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/pass/package-use.html | 12 +-
.../protocol/ProtocolURLNormalizer.html | 12 +-
.../protocol/class-use/ProtocolURLNormalizer.html | 12 +-
.../urlnormalizer/protocol/package-summary.html | 12 +-
.../net/urlnormalizer/protocol/package-tree.html | 12 +-
.../net/urlnormalizer/protocol/package-use.html | 12 +-
.../querystring/QuerystringURLNormalizer.html | 12 +-
.../class-use/QuerystringURLNormalizer.html | 12 +-
.../urlnormalizer/querystring/package-summary.html | 12 +-
.../urlnormalizer/querystring/package-tree.html | 12 +-
.../net/urlnormalizer/querystring/package-use.html | 12 +-
.../urlnormalizer/regex/RegexURLNormalizer.html | 12 +-
.../regex/class-use/RegexURLNormalizer.html | 12 +-
.../net/urlnormalizer/regex/package-summary.html | 12 +-
.../net/urlnormalizer/regex/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/regex/package-use.html | 12 +-
.../urlnormalizer/slash/SlashURLNormalizer.html | 12 +-
.../slash/class-use/SlashURLNormalizer.html | 12 +-
.../net/urlnormalizer/slash/package-summary.html | 12 +-
.../net/urlnormalizer/slash/package-tree.html | 12 +-
.../nutch/net/urlnormalizer/slash/package-use.html | 12 +-
.../api/org/apache/nutch/parse/HTMLMetaTags.html | 12 +-
.../org/apache/nutch/parse/HtmlParseFilter.html | 12 +-
.../org/apache/nutch/parse/HtmlParseFilters.html | 12 +-
.../api/org/apache/nutch/parse/Outlink.html | 12 +-
.../org/apache/nutch/parse/OutlinkExtractor.html | 12 +-
.../javadoc/api/org/apache/nutch/parse/Parse.html | 12 +-
.../api/org/apache/nutch/parse/ParseData.html | 12 +-
.../api/org/apache/nutch/parse/ParseException.html | 12 +-
.../api/org/apache/nutch/parse/ParseImpl.html | 12 +-
.../org/apache/nutch/parse/ParseOutputFormat.html | 12 +-
.../api/org/apache/nutch/parse/ParseResult.html | 12 +-
.../parse/ParseSegment.ParseSegmentMapper.html | 12 +-
.../parse/ParseSegment.ParseSegmentReducer.html | 12 +-
.../api/org/apache/nutch/parse/ParseSegment.html | 12 +-
.../api/org/apache/nutch/parse/ParseStatus.html | 12 +-
.../api/org/apache/nutch/parse/ParseText.html | 12 +-
.../api/org/apache/nutch/parse/ParseUtil.html | 12 +-
.../javadoc/api/org/apache/nutch/parse/Parser.html | 12 +-
.../api/org/apache/nutch/parse/ParserChecker.html | 12 +-
.../api/org/apache/nutch/parse/ParserFactory.html | 12 +-
.../api/org/apache/nutch/parse/ParserNotFound.html | 12 +-
.../apache/nutch/parse/class-use/HTMLMetaTags.html | 12 +-
.../nutch/parse/class-use/HtmlParseFilter.html | 12 +-
.../nutch/parse/class-use/HtmlParseFilters.html | 12 +-
.../org/apache/nutch/parse/class-use/Outlink.html | 12 +-
.../nutch/parse/class-use/OutlinkExtractor.html | 12 +-
.../org/apache/nutch/parse/class-use/Parse.html | 48 +-
.../apache/nutch/parse/class-use/ParseData.html | 12 +-
.../nutch/parse/class-use/ParseException.html | 12 +-
.../apache/nutch/parse/class-use/ParseImpl.html | 12 +-
.../nutch/parse/class-use/ParseOutputFormat.html | 12 +-
.../apache/nutch/parse/class-use/ParseResult.html | 12 +-
.../class-use/ParseSegment.ParseSegmentMapper.html | 12 +-
.../ParseSegment.ParseSegmentReducer.html | 12 +-
.../apache/nutch/parse/class-use/ParseSegment.html | 12 +-
.../apache/nutch/parse/class-use/ParseStatus.html | 12 +-
.../apache/nutch/parse/class-use/ParseText.html | 12 +-
.../apache/nutch/parse/class-use/ParseUtil.html | 12 +-
.../org/apache/nutch/parse/class-use/Parser.html | 12 +-
.../nutch/parse/class-use/ParserChecker.html | 12 +-
.../nutch/parse/class-use/ParserFactory.html | 12 +-
.../nutch/parse/class-use/ParserNotFound.html | 12 +-
.../api/org/apache/nutch/parse/ext/ExtParser.html | 12 +-
.../nutch/parse/ext/class-use/ExtParser.html | 12 +-
.../apache/nutch/parse/ext/package-summary.html | 12 +-
.../org/apache/nutch/parse/ext/package-tree.html | 12 +-
.../org/apache/nutch/parse/ext/package-use.html | 12 +-
.../org/apache/nutch/parse/feed/FeedParser.html | 12 +-
.../nutch/parse/feed/class-use/FeedParser.html | 12 +-
.../apache/nutch/parse/feed/package-summary.html | 12 +-
.../org/apache/nutch/parse/feed/package-tree.html | 12 +-
.../org/apache/nutch/parse/feed/package-use.html | 12 +-
.../nutch/parse/headings/HeadingsParseFilter.html | 12 +-
.../headings/class-use/HeadingsParseFilter.html | 12 +-
.../nutch/parse/headings/package-summary.html | 12 +-
.../apache/nutch/parse/headings/package-tree.html | 12 +-
.../apache/nutch/parse/headings/package-use.html | 12 +-
.../org/apache/nutch/parse/html/DOMBuilder.html | 12 +-
.../parse/html/DOMContentUtils.LinkParams.html | 12 +-
.../apache/nutch/parse/html/DOMContentUtils.html | 12 +-
.../apache/nutch/parse/html/HTMLMetaProcessor.html | 12 +-
.../org/apache/nutch/parse/html/HtmlParser.html | 12 +-
.../nutch/parse/html/XMLCharacterRecognizer.html | 12 +-
.../nutch/parse/html/class-use/DOMBuilder.html | 12 +-
.../html/class-use/DOMContentUtils.LinkParams.html | 12 +-
.../parse/html/class-use/DOMContentUtils.html | 12 +-
.../parse/html/class-use/HTMLMetaProcessor.html | 12 +-
.../nutch/parse/html/class-use/HtmlParser.html | 12 +-
.../html/class-use/XMLCharacterRecognizer.html | 12 +-
.../apache/nutch/parse/html/package-summary.html | 12 +-
.../org/apache/nutch/parse/html/package-tree.html | 12 +-
.../org/apache/nutch/parse/html/package-use.html | 12 +-
.../org/apache/nutch/parse/js/JSParseFilter.html | 12 +-
.../nutch/parse/js/class-use/JSParseFilter.html | 12 +-
.../org/apache/nutch/parse/js/package-summary.html | 12 +-
.../org/apache/nutch/parse/js/package-tree.html | 12 +-
.../api/org/apache/nutch/parse/js/package-use.html | 12 +-
.../nutch/parse/metatags/MetaTagsParser.html | 12 +-
.../parse/metatags/class-use/MetaTagsParser.html | 12 +-
.../nutch/parse/metatags/package-summary.html | 12 +-
.../apache/nutch/parse/metatags/package-tree.html | 12 +-
.../apache/nutch/parse/metatags/package-use.html | 12 +-
.../org/apache/nutch/parse/package-summary.html | 12 +-
.../api/org/apache/nutch/parse/package-tree.html | 12 +-
.../api/org/apache/nutch/parse/package-use.html | 45 +-
.../apache/nutch/parse/tika/DOMContentUtils.html | 16 +-
.../apache/nutch/parse/tika/HTMLMetaProcessor.html | 12 +-
.../org/apache/nutch/parse/tika/TikaParser.html | 12 +-
.../parse/tika/class-use/DOMContentUtils.html | 12 +-
.../parse/tika/class-use/HTMLMetaProcessor.html | 12 +-
.../nutch/parse/tika/class-use/TikaParser.html | 12 +-
.../apache/nutch/parse/tika/package-summary.html | 12 +-
.../org/apache/nutch/parse/tika/package-tree.html | 12 +-
.../org/apache/nutch/parse/tika/package-use.html | 12 +-
.../api/org/apache/nutch/parse/zip/ZipParser.html | 12 +-
.../apache/nutch/parse/zip/ZipTextExtractor.html | 12 +-
.../nutch/parse/zip/class-use/ZipParser.html | 12 +-
.../parse/zip/class-use/ZipTextExtractor.html | 12 +-
.../apache/nutch/parse/zip/package-summary.html | 12 +-
.../org/apache/nutch/parse/zip/package-tree.html | 12 +-
.../org/apache/nutch/parse/zip/package-use.html | 12 +-
.../nutch/parsefilter/debug/DebugParseFilter.html | 12 +-
.../debug/class-use/DebugParseFilter.html | 12 +-
.../nutch/parsefilter/debug/package-summary.html | 12 +-
.../nutch/parsefilter/debug/package-tree.html | 12 +-
.../nutch/parsefilter/debug/package-use.html | 12 +-
.../nutch/parsefilter/naivebayes/Classify.html | 12 +-
.../naivebayes/NaiveBayesParseFilter.html | 12 +-
.../apache/nutch/parsefilter/naivebayes/Train.html | 12 +-
.../parsefilter/naivebayes/class-use/Classify.html | 12 +-
.../class-use/NaiveBayesParseFilter.html | 12 +-
.../parsefilter/naivebayes/class-use/Train.html | 12 +-
.../parsefilter/naivebayes/package-summary.html | 12 +-
.../nutch/parsefilter/naivebayes/package-tree.html | 12 +-
.../nutch/parsefilter/naivebayes/package-use.html | 12 +-
.../nutch/parsefilter/regex/RegexParseFilter.html | 12 +-
.../regex/class-use/RegexParseFilter.html | 12 +-
.../nutch/parsefilter/regex/package-summary.html | 12 +-
.../nutch/parsefilter/regex/package-tree.html | 12 +-
.../nutch/parsefilter/regex/package-use.html | 12 +-
.../nutch/plugin/CircularDependencyException.html | 12 +-
.../api/org/apache/nutch/plugin/Extension.html | 12 +-
.../org/apache/nutch/plugin/ExtensionPoint.html | 12 +-
.../nutch/plugin/MissingDependencyException.html | 12 +-
.../api/org/apache/nutch/plugin/Pluggable.html | 14 +-
.../api/org/apache/nutch/plugin/Plugin.html | 12 +-
.../org/apache/nutch/plugin/PluginClassLoader.html | 12 +-
.../org/apache/nutch/plugin/PluginDescriptor.html | 12 +-
.../apache/nutch/plugin/PluginManifestParser.html | 12 +-
.../org/apache/nutch/plugin/PluginRepository.html | 12 +-
.../nutch/plugin/PluginRuntimeException.html | 12 +-
.../nutch/plugin/URLStreamHandlerFactory.html | 18 +-
.../class-use/CircularDependencyException.html | 12 +-
.../apache/nutch/plugin/class-use/Extension.html | 12 +-
.../nutch/plugin/class-use/ExtensionPoint.html | 12 +-
.../class-use/MissingDependencyException.html | 12 +-
.../apache/nutch/plugin/class-use/Pluggable.html | 71 +-
.../org/apache/nutch/plugin/class-use/Plugin.html | 12 +-
.../nutch/plugin/class-use/PluginClassLoader.html | 12 +-
.../nutch/plugin/class-use/PluginDescriptor.html | 12 +-
.../plugin/class-use/PluginManifestParser.html | 12 +-
.../nutch/plugin/class-use/PluginRepository.html | 12 +-
.../plugin/class-use/PluginRuntimeException.html | 12 +-
.../plugin/class-use/URLStreamHandlerFactory.html | 12 +-
.../org/apache/nutch/plugin/package-summary.html | 12 +-
.../api/org/apache/nutch/plugin/package-tree.html | 12 +-
.../api/org/apache/nutch/plugin/package-use.html | 59 +-
.../api/org/apache/nutch/protocol/Content.html | 12 +-
.../api/org/apache/nutch/protocol/Protocol.html | 12 +-
.../apache/nutch/protocol/ProtocolException.html | 12 +-
.../org/apache/nutch/protocol/ProtocolFactory.html | 12 +-
.../apache/nutch/protocol/ProtocolNotFound.html | 12 +-
.../org/apache/nutch/protocol/ProtocolOutput.html | 12 +-
.../org/apache/nutch/protocol/ProtocolStatus.html | 12 +-
.../apache/nutch/protocol/RobotRulesParser.html | 12 +-
.../apache/nutch/protocol/class-use/Content.html | 12 +-
.../apache/nutch/protocol/class-use/Protocol.html | 12 +-
.../protocol/class-use/ProtocolException.html | 12 +-
.../nutch/protocol/class-use/ProtocolFactory.html | 12 +-
.../nutch/protocol/class-use/ProtocolNotFound.html | 12 +-
.../nutch/protocol/class-use/ProtocolOutput.html | 12 +-
.../nutch/protocol/class-use/ProtocolStatus.html | 12 +-
.../nutch/protocol/class-use/RobotRulesParser.html | 12 +-
.../api/org/apache/nutch/protocol/file/File.html | 12 +-
.../org/apache/nutch/protocol/file/FileError.html | 12 +-
.../apache/nutch/protocol/file/FileException.html | 12 +-
.../apache/nutch/protocol/file/FileResponse.html | 12 +-
.../apache/nutch/protocol/file/class-use/File.html | 12 +-
.../nutch/protocol/file/class-use/FileError.html | 12 +-
.../protocol/file/class-use/FileException.html | 12 +-
.../protocol/file/class-use/FileResponse.html | 12 +-
.../nutch/protocol/file/package-summary.html | 12 +-
.../apache/nutch/protocol/file/package-tree.html | 12 +-
.../apache/nutch/protocol/file/package-use.html | 12 +-
.../api/org/apache/nutch/protocol/ftp/Client.html | 12 +-
.../api/org/apache/nutch/protocol/ftp/Ftp.html | 12 +-
.../org/apache/nutch/protocol/ftp/FtpError.html | 12 +-
.../apache/nutch/protocol/ftp/FtpException.html | 12 +-
.../protocol/ftp/FtpExceptionBadSystResponse.html | 12 +-
.../ftp/FtpExceptionCanNotHaveDataConnection.html | 12 +-
...FtpExceptionControlClosedByForcedDataClose.html | 12 +-
.../ftp/FtpExceptionUnknownForcedDataClose.html | 12 +-
.../org/apache/nutch/protocol/ftp/FtpResponse.html | 12 +-
.../nutch/protocol/ftp/FtpRobotRulesParser.html | 12 +-
.../nutch/protocol/ftp/PrintCommandListener.html | 12 +-
.../nutch/protocol/ftp/class-use/Client.html | 12 +-
.../apache/nutch/protocol/ftp/class-use/Ftp.html | 12 +-
.../nutch/protocol/ftp/class-use/FtpError.html | 12 +-
.../nutch/protocol/ftp/class-use/FtpException.html | 12 +-
.../ftp/class-use/FtpExceptionBadSystResponse.html | 12 +-
.../FtpExceptionCanNotHaveDataConnection.html | 12 +-
...FtpExceptionControlClosedByForcedDataClose.html | 12 +-
.../FtpExceptionUnknownForcedDataClose.html | 12 +-
.../nutch/protocol/ftp/class-use/FtpResponse.html | 12 +-
.../ftp/class-use/FtpRobotRulesParser.html | 12 +-
.../ftp/class-use/PrintCommandListener.html | 12 +-
.../apache/nutch/protocol/ftp/package-summary.html | 12 +-
.../apache/nutch/protocol/ftp/package-tree.html | 12 +-
.../org/apache/nutch/protocol/ftp/package-use.html | 12 +-
.../protocol/htmlunit/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/htmlunit/HtmlUnitWebDriver.html | 12 +-
.../htmlunit/HtmlUnitWebWindowListener.html | 12 +-
.../org/apache/nutch/protocol/htmlunit/Http.html | 14 +-
.../protocol/htmlunit/HttpResponse.Scheme.html | 12 +-
.../nutch/protocol/htmlunit/HttpResponse.html | 14 +-
.../htmlunit/class-use/DummyX509TrustManager.html | 12 +-
.../htmlunit/class-use/HtmlUnitWebDriver.html | 12 +-
.../class-use/HtmlUnitWebWindowListener.html | 12 +-
.../nutch/protocol/htmlunit/class-use/Http.html | 12 +-
.../htmlunit/class-use/HttpResponse.Scheme.html | 12 +-
.../protocol/htmlunit/class-use/HttpResponse.html | 12 +-
.../nutch/protocol/htmlunit/package-summary.html | 12 +-
.../nutch/protocol/htmlunit/package-tree.html | 12 +-
.../nutch/protocol/htmlunit/package-use.html | 12 +-
.../nutch/protocol/http/DummyX509TrustManager.html | 12 +-
.../api/org/apache/nutch/protocol/http/Http.html | 14 +-
.../nutch/protocol/http/HttpResponse.Scheme.html | 12 +-
.../apache/nutch/protocol/http/HttpResponse.html | 14 +-
.../nutch/protocol/http/api/BlockedException.html | 12 +-
.../apache/nutch/protocol/http/api/HttpBase.html | 45 +-
.../nutch/protocol/http/api/HttpException.html | 12 +-
.../protocol/http/api/HttpRobotRulesParser.html | 12 +-
.../http/api/class-use/BlockedException.html | 12 +-
.../protocol/http/api/class-use/HttpBase.html | 12 +-
.../protocol/http/api/class-use/HttpException.html | 12 +-
.../http/api/class-use/HttpRobotRulesParser.html | 12 +-
.../nutch/protocol/http/api/package-summary.html | 12 +-
.../nutch/protocol/http/api/package-tree.html | 12 +-
.../nutch/protocol/http/api/package-use.html | 12 +-
.../http/class-use/DummyX509TrustManager.html | 12 +-
.../apache/nutch/protocol/http/class-use/Http.html | 12 +-
.../http/class-use/HttpResponse.Scheme.html | 12 +-
.../protocol/http/class-use/HttpResponse.html | 12 +-
.../nutch/protocol/http/package-summary.html | 12 +-
.../apache/nutch/protocol/http/package-tree.html | 12 +-
.../apache/nutch/protocol/http/package-use.html | 12 +-
.../httpclient/DummySSLProtocolSocketFactory.html | 12 +-
.../protocol/httpclient/DummyX509TrustManager.html | 12 +-
.../org/apache/nutch/protocol/httpclient/Http.html | 14 +-
.../protocol/httpclient/HttpAuthentication.html | 12 +-
.../httpclient/HttpAuthenticationException.html | 12 +-
.../httpclient/HttpAuthenticationFactory.html | 12 +-
.../httpclient/HttpBasicAuthentication.html | 12 +-
.../httpclient/HttpFormAuthConfigurer.html | 12 +-
.../httpclient/HttpFormAuthentication.html | 12 +-
.../nutch/protocol/httpclient/HttpResponse.html | 14 +-
.../class-use/DummySSLProtocolSocketFactory.html | 12 +-
.../class-use/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/httpclient/class-use/Http.html | 12 +-
.../httpclient/class-use/HttpAuthentication.html | 12 +-
.../class-use/HttpAuthenticationException.html | 12 +-
.../class-use/HttpAuthenticationFactory.html | 12 +-
.../class-use/HttpBasicAuthentication.html | 12 +-
.../class-use/HttpFormAuthConfigurer.html | 12 +-
.../class-use/HttpFormAuthentication.html | 12 +-
.../httpclient/class-use/HttpResponse.html | 12 +-
.../nutch/protocol/httpclient/package-summary.html | 12 +-
.../nutch/protocol/httpclient/package-tree.html | 12 +-
.../nutch/protocol/httpclient/package-use.html | 12 +-
.../interactiveselenium/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/interactiveselenium/Http.html | 14 +-
.../interactiveselenium/HttpResponse.Scheme.html | 12 +-
.../protocol/interactiveselenium/HttpResponse.html | 14 +-
.../class-use/DummyX509TrustManager.html | 12 +-
.../interactiveselenium/class-use/Http.html | 12 +-
.../class-use/HttpResponse.Scheme.html | 12 +-
.../class-use/HttpResponse.html | 12 +-
.../handlers/DefalultMultiInteractionHandler.html | 12 +-
.../handlers/DefaultClickAllAjaxLinksHandler.html | 12 +-
.../handlers/DefaultHandler.html | 12 +-
.../handlers/InteractiveSeleniumHandler.html | 12 +-
.../class-use/DefalultMultiInteractionHandler.html | 12 +-
.../class-use/DefaultClickAllAjaxLinksHandler.html | 12 +-
.../handlers/class-use/DefaultHandler.html | 12 +-
.../class-use/InteractiveSeleniumHandler.html | 12 +-
.../handlers/package-summary.html | 12 +-
.../interactiveselenium/handlers/package-tree.html | 12 +-
.../interactiveselenium/handlers/package-use.html | 12 +-
.../interactiveselenium/package-summary.html | 12 +-
.../protocol/interactiveselenium/package-tree.html | 12 +-
.../protocol/interactiveselenium/package-use.html | 12 +-
.../api/org/apache/nutch/protocol/okhttp/CIDR.html | 12 +-
.../nutch/protocol/okhttp/IPFilterRules.html | 12 +-
.../org/apache/nutch/protocol/okhttp/OkHttp.html | 14 +-
.../okhttp/OkHttpResponse.TruncatedContent.html | 12 +-
.../nutch/protocol/okhttp/OkHttpResponse.html | 14 +-
.../nutch/protocol/okhttp/class-use/CIDR.html | 12 +-
.../protocol/okhttp/class-use/IPFilterRules.html | 12 +-
.../nutch/protocol/okhttp/class-use/OkHttp.html | 12 +-
.../class-use/OkHttpResponse.TruncatedContent.html | 12 +-
.../protocol/okhttp/class-use/OkHttpResponse.html | 12 +-
.../nutch/protocol/okhttp/package-summary.html | 12 +-
.../apache/nutch/protocol/okhttp/package-tree.html | 12 +-
.../apache/nutch/protocol/okhttp/package-use.html | 12 +-
.../org/apache/nutch/protocol/package-summary.html | 12 +-
.../org/apache/nutch/protocol/package-tree.html | 12 +-
.../api/org/apache/nutch/protocol/package-use.html | 12 +-
.../protocol/selenium/DummyX509TrustManager.html | 12 +-
.../org/apache/nutch/protocol/selenium/Http.html | 14 +-
.../protocol/selenium/HttpResponse.Scheme.html | 12 +-
.../nutch/protocol/selenium/HttpResponse.html | 14 +-
.../nutch/protocol/selenium/HttpWebClient.html | 12 +-
.../selenium/class-use/DummyX509TrustManager.html | 12 +-
.../nutch/protocol/selenium/class-use/Http.html | 12 +-
.../selenium/class-use/HttpResponse.Scheme.html | 12 +-
.../protocol/selenium/class-use/HttpResponse.html | 12 +-
.../protocol/selenium/class-use/HttpWebClient.html | 12 +-
.../nutch/protocol/selenium/package-summary.html | 12 +-
.../nutch/protocol/selenium/package-tree.html | 12 +-
.../nutch/protocol/selenium/package-use.html | 12 +-
.../org/apache/nutch/publisher/NutchPublisher.html | 12 +-
.../apache/nutch/publisher/NutchPublishers.html | 12 +-
.../nutch/publisher/class-use/NutchPublisher.html | 12 +-
.../nutch/publisher/class-use/NutchPublishers.html | 12 +-
.../apache/nutch/publisher/package-summary.html | 12 +-
.../org/apache/nutch/publisher/package-tree.html | 12 +-
.../org/apache/nutch/publisher/package-use.html | 12 +-
.../publisher/rabbitmq/RabbitMQPublisherImpl.html | 12 +-
.../rabbitmq/class-use/RabbitMQPublisherImpl.html | 12 +-
.../nutch/publisher/rabbitmq/package-summary.html | 12 +-
.../nutch/publisher/rabbitmq/package-tree.html | 12 +-
.../nutch/publisher/rabbitmq/package-use.html | 12 +-
.../org/apache/nutch/rabbitmq/RabbitMQClient.html | 12 +-
.../org/apache/nutch/rabbitmq/RabbitMQMessage.html | 12 +-
.../nutch/rabbitmq/class-use/RabbitMQClient.html | 12 +-
.../nutch/rabbitmq/class-use/RabbitMQMessage.html | 12 +-
.../org/apache/nutch/rabbitmq/package-summary.html | 12 +-
.../org/apache/nutch/rabbitmq/package-tree.html | 12 +-
.../api/org/apache/nutch/rabbitmq/package-use.html | 12 +-
.../nutch/scoring/AbstractScoringFilter.html | 14 +-
.../org/apache/nutch/scoring/ScoringFilter.html | 14 +-
.../nutch/scoring/ScoringFilterException.html | 12 +-
.../org/apache/nutch/scoring/ScoringFilters.html | 12 +-
.../scoring/class-use/AbstractScoringFilter.html | 42 +-
.../nutch/scoring/class-use/ScoringFilter.html | 42 +-
.../scoring/class-use/ScoringFilterException.html | 46 +-
.../nutch/scoring/class-use/ScoringFilters.html | 12 +-
.../nutch/scoring/depth/DepthScoringFilter.html | 12 +-
.../depth/class-use/DepthScoringFilter.html | 12 +-
.../nutch/scoring/depth/package-summary.html | 12 +-
.../apache/nutch/scoring/depth/package-tree.html | 12 +-
.../apache/nutch/scoring/depth/package-use.html | 12 +-
.../scoring/link/LinkAnalysisScoringFilter.html | 12 +-
.../link/class-use/LinkAnalysisScoringFilter.html | 12 +-
.../apache/nutch/scoring/link/package-summary.html | 12 +-
.../apache/nutch/scoring/link/package-tree.html | 12 +-
.../org/apache/nutch/scoring/link/package-use.html | 12 +-
.../scoring/metadata/MetadataScoringFilter.html | 12 +-
.../metadata/class-use/MetadataScoringFilter.html | 12 +-
.../nutch/scoring/metadata/package-summary.html | 12 +-
.../nutch/scoring/metadata/package-tree.html | 12 +-
.../apache/nutch/scoring/metadata/package-use.html | 12 +-
.../nutch/scoring/opic/OPICScoringFilter.html | 12 +-
.../scoring/opic/class-use/OPICScoringFilter.html | 12 +-
.../apache/nutch/scoring/opic/package-summary.html | 12 +-
.../apache/nutch/scoring/opic/package-tree.html | 12 +-
.../org/apache/nutch/scoring/opic/package-use.html | 12 +-
.../nutch/scoring/orphan/OrphanScoringFilter.html | 12 +-
.../orphan/class-use/OrphanScoringFilter.html | 12 +-
.../nutch/scoring/orphan/package-summary.html | 12 +-
.../apache/nutch/scoring/orphan/package-tree.html | 12 +-
.../apache/nutch/scoring/orphan/package-use.html | 12 +-
.../org/apache/nutch/scoring/package-summary.html | 12 +-
.../api/org/apache/nutch/scoring/package-tree.html | 12 +-
.../api/org/apache/nutch/scoring/package-use.html | 47 +-
.../nutch/scoring/similarity/SimilarityModel.html | 12 +-
.../similarity/SimilarityScoringFilter.html | 12 +-
.../similarity/class-use/SimilarityModel.html | 12 +-
.../class-use/SimilarityScoringFilter.html | 12 +-
.../similarity/cosine/CosineSimilarity.html | 12 +-
.../nutch/scoring/similarity/cosine/DocVector.html | 12 +-
.../nutch/scoring/similarity/cosine/Model.html | 12 +-
.../cosine/class-use/CosineSimilarity.html | 12 +-
.../similarity/cosine/class-use/DocVector.html | 12 +-
.../scoring/similarity/cosine/class-use/Model.html | 12 +-
.../scoring/similarity/cosine/package-summary.html | 12 +-
.../scoring/similarity/cosine/package-tree.html | 12 +-
.../scoring/similarity/cosine/package-use.html | 12 +-
.../nutch/scoring/similarity/package-summary.html | 12 +-
.../nutch/scoring/similarity/package-tree.html | 12 +-
.../nutch/scoring/similarity/package-use.html | 12 +-
.../util/LuceneAnalyzerUtil.StemFilterType.html | 12 +-
.../similarity/util/LuceneAnalyzerUtil.html | 12 +-
.../util/LuceneTokenizer.TokenizerType.html | 12 +-
.../scoring/similarity/util/LuceneTokenizer.html | 12 +-
.../LuceneAnalyzerUtil.StemFilterType.html | 12 +-
.../util/class-use/LuceneAnalyzerUtil.html | 12 +-
.../class-use/LuceneTokenizer.TokenizerType.html | 12 +-
.../similarity/util/class-use/LuceneTokenizer.html | 12 +-
.../scoring/similarity/util/package-summary.html | 12 +-
.../scoring/similarity/util/package-tree.html | 12 +-
.../nutch/scoring/similarity/util/package-use.html | 12 +-
.../apache/nutch/scoring/tld/TLDScoringFilter.html | 399 ----------
.../scoring/tld/class-use/TLDScoringFilter.html | 150 ----
.../apache/nutch/scoring/tld/package-summary.html | 175 -----
.../org/apache/nutch/scoring/tld/package-tree.html | 169 -----
.../org/apache/nutch/scoring/tld/package-use.html | 150 ----
.../scoring/urlmeta/URLMetaScoringFilter.html | 12 +-
.../urlmeta/class-use/URLMetaScoringFilter.html | 12 +-
.../nutch/scoring/urlmeta/package-summary.html | 12 +-
.../apache/nutch/scoring/urlmeta/package-tree.html | 12 +-
.../apache/nutch/scoring/urlmeta/package-use.html | 12 +-
.../apache/nutch/scoring/webgraph/LinkDatum.html | 12 +-
.../webgraph/LinkDumper.Inverter.InvertMapper.html | 12 +-
.../LinkDumper.Inverter.InvertReducer.html | 12 +-
.../scoring/webgraph/LinkDumper.Inverter.html | 12 +-
.../scoring/webgraph/LinkDumper.LinkNode.html | 12 +-
.../scoring/webgraph/LinkDumper.LinkNodes.html | 12 +-
.../nutch/scoring/webgraph/LinkDumper.Merger.html | 12 +-
.../nutch/scoring/webgraph/LinkDumper.Reader.html | 14 +-
.../apache/nutch/scoring/webgraph/LinkDumper.html | 12 +-
.../apache/nutch/scoring/webgraph/LinkRank.html | 12 +-
.../org/apache/nutch/scoring/webgraph/Node.html | 12 +-
.../webgraph/NodeDumper.Dumper.DumperMapper.html | 12 +-
.../webgraph/NodeDumper.Dumper.DumperReducer.html | 12 +-
.../nutch/scoring/webgraph/NodeDumper.Dumper.html | 12 +-
.../webgraph/NodeDumper.Sorter.SorterMapper.html | 12 +-
.../webgraph/NodeDumper.Sorter.SorterReducer.html | 12 +-
.../nutch/scoring/webgraph/NodeDumper.Sorter.html | 12 +-
.../apache/nutch/scoring/webgraph/NodeDumper.html | 12 +-
.../apache/nutch/scoring/webgraph/NodeReader.html | 12 +-
.../webgraph/ScoreUpdater.ScoreUpdaterMapper.html | 12 +-
.../webgraph/ScoreUpdater.ScoreUpdaterReducer.html | 12 +-
.../nutch/scoring/webgraph/ScoreUpdater.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbMapper.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbReducer.html | 12 +-
.../nutch/scoring/webgraph/WebGraph.OutlinkDb.html | 12 +-
.../apache/nutch/scoring/webgraph/WebGraph.html | 12 +-
.../scoring/webgraph/class-use/LinkDatum.html | 12 +-
.../LinkDumper.Inverter.InvertMapper.html | 12 +-
.../LinkDumper.Inverter.InvertReducer.html | 12 +-
.../webgraph/class-use/LinkDumper.Inverter.html | 12 +-
.../webgraph/class-use/LinkDumper.LinkNode.html | 12 +-
.../webgraph/class-use/LinkDumper.LinkNodes.html | 12 +-
.../webgraph/class-use/LinkDumper.Merger.html | 12 +-
.../webgraph/class-use/LinkDumper.Reader.html | 12 +-
.../scoring/webgraph/class-use/LinkDumper.html | 12 +-
.../nutch/scoring/webgraph/class-use/LinkRank.html | 12 +-
.../nutch/scoring/webgraph/class-use/Node.html | 12 +-
.../class-use/NodeDumper.Dumper.DumperMapper.html | 12 +-
.../class-use/NodeDumper.Dumper.DumperReducer.html | 12 +-
.../webgraph/class-use/NodeDumper.Dumper.html | 12 +-
.../class-use/NodeDumper.Sorter.SorterMapper.html | 12 +-
.../class-use/NodeDumper.Sorter.SorterReducer.html | 12 +-
.../webgraph/class-use/NodeDumper.Sorter.html | 12 +-
.../scoring/webgraph/class-use/NodeDumper.html | 12 +-
.../scoring/webgraph/class-use/NodeReader.html | 12 +-
.../class-use/ScoreUpdater.ScoreUpdaterMapper.html | 12 +-
.../ScoreUpdater.ScoreUpdaterReducer.html | 12 +-
.../scoring/webgraph/class-use/ScoreUpdater.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbMapper.html | 12 +-
.../WebGraph.OutlinkDb.OutlinkDbReducer.html | 12 +-
.../webgraph/class-use/WebGraph.OutlinkDb.html | 12 +-
.../nutch/scoring/webgraph/class-use/WebGraph.html | 12 +-
.../nutch/scoring/webgraph/package-summary.html | 12 +-
.../nutch/scoring/webgraph/package-tree.html | 12 +-
.../apache/nutch/scoring/webgraph/package-use.html | 12 +-
.../nutch/segment/ContentAsTextInputFormat.html | 12 +-
.../org/apache/nutch/segment/SegmentChecker.html | 12 +-
.../apache/nutch/segment/SegmentMergeFilter.html | 12 +-
.../apache/nutch/segment/SegmentMergeFilters.html | 12 +-
.../segment/SegmentMerger.ObjectInputFormat.html | 12 +-
.../segment/SegmentMerger.SegmentMergerMapper.html | 12 +-
.../SegmentMerger.SegmentMergerReducer.html | 12 +-
.../segment/SegmentMerger.SegmentOutputFormat.html | 12 +-
.../org/apache/nutch/segment/SegmentMerger.html | 12 +-
.../api/org/apache/nutch/segment/SegmentPart.html | 12 +-
.../segment/SegmentReader.InputCompatMapper.html | 12 +-
.../segment/SegmentReader.InputCompatReducer.html | 12 +-
.../segment/SegmentReader.SegmentReaderStats.html | 12 +-
.../segment/SegmentReader.TextOutputFormat.html | 12 +-
.../org/apache/nutch/segment/SegmentReader.html | 12 +-
.../class-use/ContentAsTextInputFormat.html | 12 +-
.../nutch/segment/class-use/SegmentChecker.html | 12 +-
.../segment/class-use/SegmentMergeFilter.html | 12 +-
.../segment/class-use/SegmentMergeFilters.html | 12 +-
.../class-use/SegmentMerger.ObjectInputFormat.html | 12 +-
.../SegmentMerger.SegmentMergerMapper.html | 12 +-
.../SegmentMerger.SegmentMergerReducer.html | 12 +-
.../SegmentMerger.SegmentOutputFormat.html | 12 +-
.../nutch/segment/class-use/SegmentMerger.html | 12 +-
.../nutch/segment/class-use/SegmentPart.html | 12 +-
.../class-use/SegmentReader.InputCompatMapper.html | 12 +-
.../SegmentReader.InputCompatReducer.html | 12 +-
.../SegmentReader.SegmentReaderStats.html | 12 +-
.../class-use/SegmentReader.TextOutputFormat.html | 12 +-
.../nutch/segment/class-use/SegmentReader.html | 12 +-
.../org/apache/nutch/segment/package-summary.html | 12 +-
.../api/org/apache/nutch/segment/package-tree.html | 12 +-
.../api/org/apache/nutch/segment/package-use.html | 12 +-
.../api/org/apache/nutch/service/ConfManager.html | 12 +-
.../apache/nutch/service/JobManager.JobType.html | 12 +-
.../api/org/apache/nutch/service/JobManager.html | 12 +-
.../api/org/apache/nutch/service/NutchReader.html | 36 +-
.../api/org/apache/nutch/service/NutchServer.html | 12 +-
.../api/org/apache/nutch/service/SeedManager.html | 12 +-
.../nutch/service/class-use/ConfManager.html | 12 +-
.../service/class-use/JobManager.JobType.html | 12 +-
.../apache/nutch/service/class-use/JobManager.html | 12 +-
.../nutch/service/class-use/NutchReader.html | 12 +-
.../nutch/service/class-use/NutchServer.html | 12 +-
.../nutch/service/class-use/SeedManager.html | 12 +-
.../apache/nutch/service/impl/ConfManagerImpl.html | 12 +-
.../org/apache/nutch/service/impl/JobFactory.html | 12 +-
.../apache/nutch/service/impl/JobManagerImpl.html | 12 +-
.../org/apache/nutch/service/impl/JobWorker.html | 12 +-
.../org/apache/nutch/service/impl/LinkReader.html | 36 +-
.../org/apache/nutch/service/impl/NodeReader.html | 36 +-
.../service/impl/NutchServerPoolExecutor.html | 12 +-
.../apache/nutch/service/impl/SeedManagerImpl.html | 12 +-
.../apache/nutch/service/impl/SequenceReader.html | 12 +-
.../apache/nutch/service/impl/ServiceWorker.html | 12 +-
.../service/impl/class-use/ConfManagerImpl.html | 12 +-
.../nutch/service/impl/class-use/JobFactory.html | 12 +-
.../service/impl/class-use/JobManagerImpl.html | 12 +-
.../nutch/service/impl/class-use/JobWorker.html | 12 +-
.../nutch/service/impl/class-use/LinkReader.html | 12 +-
.../nutch/service/impl/class-use/NodeReader.html | 12 +-
.../impl/class-use/NutchServerPoolExecutor.html | 12 +-
.../service/impl/class-use/SeedManagerImpl.html | 12 +-
.../service/impl/class-use/SequenceReader.html | 12 +-
.../service/impl/class-use/ServiceWorker.html | 12 +-
.../apache/nutch/service/impl/package-summary.html | 12 +-
.../apache/nutch/service/impl/package-tree.html | 12 +-
.../org/apache/nutch/service/impl/package-use.html | 12 +-
.../nutch/service/model/request/DbQuery.html | 12 +-
.../nutch/service/model/request/JobConfig.html | 12 +-
.../nutch/service/model/request/NutchConfig.html | 12 +-
.../nutch/service/model/request/ReaderConfig.html | 12 +-
.../nutch/service/model/request/SeedList.html | 12 +-
.../nutch/service/model/request/SeedUrl.html | 12 +-
.../nutch/service/model/request/ServiceConfig.html | 12 +-
.../service/model/request/class-use/DbQuery.html | 12 +-
.../service/model/request/class-use/JobConfig.html | 12 +-
.../model/request/class-use/NutchConfig.html | 12 +-
.../model/request/class-use/ReaderConfig.html | 12 +-
.../service/model/request/class-use/SeedList.html | 12 +-
.../service/model/request/class-use/SeedUrl.html | 12 +-
.../model/request/class-use/ServiceConfig.html | 12 +-
.../service/model/request/package-summary.html | 12 +-
.../nutch/service/model/request/package-tree.html | 12 +-
.../nutch/service/model/request/package-use.html | 12 +-
.../service/model/response/FetchNodeDbInfo.html | 12 +-
.../service/model/response/JobInfo.State.html | 12 +-
.../nutch/service/model/response/JobInfo.html | 12 +-
.../service/model/response/NutchServerInfo.html | 12 +-
.../nutch/service/model/response/ServiceInfo.html | 12 +-
.../model/response/class-use/FetchNodeDbInfo.html | 12 +-
.../model/response/class-use/JobInfo.State.html | 12 +-
.../service/model/response/class-use/JobInfo.html | 12 +-
.../model/response/class-use/NutchServerInfo.html | 12 +-
.../model/response/class-use/ServiceInfo.html | 12 +-
.../service/model/response/package-summary.html | 12 +-
.../nutch/service/model/response/package-tree.html | 12 +-
.../nutch/service/model/response/package-use.html | 12 +-
.../org/apache/nutch/service/package-summary.html | 12 +-
.../api/org/apache/nutch/service/package-tree.html | 12 +-
.../api/org/apache/nutch/service/package-use.html | 12 +-
.../nutch/service/resources/AbstractResource.html | 12 +-
.../nutch/service/resources/AdminResource.html | 12 +-
.../nutch/service/resources/ConfigResource.html | 12 +-
.../apache/nutch/service/resources/DbResource.html | 12 +-
.../nutch/service/resources/JobResource.html | 12 +-
.../nutch/service/resources/ReaderResouce.html | 12 +-
.../nutch/service/resources/SeedResource.html | 12 +-
.../nutch/service/resources/ServicesResource.html | 12 +-
.../resources/class-use/AbstractResource.html | 12 +-
.../service/resources/class-use/AdminResource.html | 12 +-
.../resources/class-use/ConfigResource.html | 12 +-
.../service/resources/class-use/DbResource.html | 12 +-
.../service/resources/class-use/JobResource.html | 12 +-
.../service/resources/class-use/ReaderResouce.html | 12 +-
.../service/resources/class-use/SeedResource.html | 12 +-
.../resources/class-use/ServicesResource.html | 12 +-
.../nutch/service/resources/package-summary.html | 12 +-
.../nutch/service/resources/package-tree.html | 12 +-
.../nutch/service/resources/package-use.html | 12 +-
.../nutch/tools/AbstractCommonCrawlFormat.html | 12 +-
.../org/apache/nutch/tools/CommonCrawlConfig.html | 12 +-
.../apache/nutch/tools/CommonCrawlDataDumper.html | 12 +-
.../org/apache/nutch/tools/CommonCrawlFormat.html | 12 +-
.../nutch/tools/CommonCrawlFormatFactory.html | 12 +-
.../nutch/tools/CommonCrawlFormatJackson.html | 12 +-
.../nutch/tools/CommonCrawlFormatJettinson.html | 12 +-
.../nutch/tools/CommonCrawlFormatSimple.html | 12 +-
.../apache/nutch/tools/CommonCrawlFormatWARC.html | 12 +-
.../api/org/apache/nutch/tools/DmozParser.html | 12 +-
.../api/org/apache/nutch/tools/FileDumper.html | 12 +-
.../nutch/tools/FreeGenerator.FG.FGMapper.html | 12 +-
.../nutch/tools/FreeGenerator.FG.FGReducer.html | 12 +-
.../org/apache/nutch/tools/FreeGenerator.FG.html | 12 +-
.../api/org/apache/nutch/tools/FreeGenerator.html | 12 +-
.../api/org/apache/nutch/tools/ResolveUrls.html | 12 +-
.../api/org/apache/nutch/tools/ShowProperties.html | 12 +-
.../api/org/apache/nutch/tools/WARCUtils.html | 12 +-
.../org/apache/nutch/tools/arc/ArcInputFormat.html | 12 +-
.../apache/nutch/tools/arc/ArcRecordReader.html | 12 +-
.../ArcSegmentCreator.ArcSegmentCreatorMapper.html | 12 +-
.../apache/nutch/tools/arc/ArcSegmentCreator.html | 12 +-
.../nutch/tools/arc/class-use/ArcInputFormat.html | 12 +-
.../nutch/tools/arc/class-use/ArcRecordReader.html | 12 +-
.../ArcSegmentCreator.ArcSegmentCreatorMapper.html | 12 +-
.../tools/arc/class-use/ArcSegmentCreator.html | 12 +-
.../apache/nutch/tools/arc/package-summary.html | 12 +-
.../org/apache/nutch/tools/arc/package-tree.html | 12 +-
.../org/apache/nutch/tools/arc/package-use.html | 12 +-
.../tools/class-use/AbstractCommonCrawlFormat.html | 12 +-
.../nutch/tools/class-use/CommonCrawlConfig.html | 12 +-
.../tools/class-use/CommonCrawlDataDumper.html | 12 +-
.../nutch/tools/class-use/CommonCrawlFormat.html | 12 +-
.../tools/class-use/CommonCrawlFormatFactory.html | 12 +-
.../tools/class-use/CommonCrawlFormatJackson.html | 12 +-
.../class-use/CommonCrawlFormatJettinson.html | 12 +-
.../tools/class-use/CommonCrawlFormatSimple.html | 12 +-
.../tools/class-use/CommonCrawlFormatWARC.html | 12 +-
.../apache/nutch/tools/class-use/DmozParser.html | 12 +-
.../apache/nutch/tools/class-use/FileDumper.html | 12 +-
.../tools/class-use/FreeGenerator.FG.FGMapper.html | 12 +-
.../class-use/FreeGenerator.FG.FGReducer.html | 12 +-
.../nutch/tools/class-use/FreeGenerator.FG.html | 12 +-
.../nutch/tools/class-use/FreeGenerator.html | 12 +-
.../apache/nutch/tools/class-use/ResolveUrls.html | 12 +-
.../nutch/tools/class-use/ShowProperties.html | 12 +-
.../apache/nutch/tools/class-use/WARCUtils.html | 12 +-
.../org/apache/nutch/tools/package-summary.html | 12 +-
.../api/org/apache/nutch/tools/package-tree.html | 12 +-
.../api/org/apache/nutch/tools/package-use.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCMapper.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCReducer.html | 12 +-
.../tools/warc/WARCExporter.WARCMapReduce.html | 12 +-
.../org/apache/nutch/tools/warc/WARCExporter.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCMapper.html | 12 +-
.../WARCExporter.WARCMapReduce.WARCReducer.html | 12 +-
.../warc/class-use/WARCExporter.WARCMapReduce.html | 12 +-
.../nutch/tools/warc/class-use/WARCExporter.html | 12 +-
.../apache/nutch/tools/warc/package-summary.html | 12 +-
.../org/apache/nutch/tools/warc/package-tree.html | 12 +-
.../org/apache/nutch/tools/warc/package-use.html | 12 +-
.../org/apache/nutch/urlfilter/api/RegexRule.html | 12 +-
.../nutch/urlfilter/api/RegexURLFilterBase.html | 18 +-
.../nutch/urlfilter/api/class-use/RegexRule.html | 12 +-
.../api/class-use/RegexURLFilterBase.html | 17 +-
.../nutch/urlfilter/api/package-summary.html | 12 +-
.../apache/nutch/urlfilter/api/package-tree.html | 12 +-
.../apache/nutch/urlfilter/api/package-use.html | 12 +-
.../urlfilter/automaton/AutomatonURLFilter.html | 14 +-
.../automaton/class-use/AutomatonURLFilter.html | 12 +-
.../nutch/urlfilter/automaton/package-summary.html | 12 +-
.../nutch/urlfilter/automaton/package-tree.html | 12 +-
.../nutch/urlfilter/automaton/package-use.html | 12 +-
.../nutch/urlfilter/domain/DomainURLFilter.html | 12 +-
.../domain/class-use/DomainURLFilter.html | 12 +-
.../nutch/urlfilter/domain/package-summary.html | 12 +-
.../nutch/urlfilter/domain/package-tree.html | 12 +-
.../apache/nutch/urlfilter/domain/package-use.html | 12 +-
.../domaindenylist/DomainDenylistURLFilter.html | 12 +-
.../class-use/DomainDenylistURLFilter.html | 12 +-
.../urlfilter/domaindenylist/package-summary.html | 12 +-
.../urlfilter/domaindenylist/package-tree.html | 12 +-
.../urlfilter/domaindenylist/package-use.html | 12 +-
.../urlfilter/fast/FastURLFilter.DenyAllRule.html | 12 +-
.../fast/FastURLFilter.DenyPathQueryRule.html | 12 +-
.../urlfilter/fast/FastURLFilter.DenyPathRule.html | 12 +-
.../nutch/urlfilter/fast/FastURLFilter.Rule.html | 12 +-
.../apache/nutch/urlfilter/fast/FastURLFilter.html | 12 +-
.../fast/class-use/FastURLFilter.DenyAllRule.html | 12 +-
.../class-use/FastURLFilter.DenyPathQueryRule.html | 12 +-
.../fast/class-use/FastURLFilter.DenyPathRule.html | 12 +-
.../fast/class-use/FastURLFilter.Rule.html | 12 +-
.../urlfilter/fast/class-use/FastURLFilter.html | 12 +-
.../nutch/urlfilter/fast/package-summary.html | 12 +-
.../apache/nutch/urlfilter/fast/package-tree.html | 12 +-
.../apache/nutch/urlfilter/fast/package-use.html | 12 +-
.../urlfilter/ignoreexempt/ExemptionUrlFilter.html | 35 +-
.../ignoreexempt/class-use/ExemptionUrlFilter.html | 12 +-
.../urlfilter/ignoreexempt/package-summary.html | 17 +-
.../nutch/urlfilter/ignoreexempt/package-tree.html | 12 +-
.../nutch/urlfilter/ignoreexempt/package-use.html | 12 +-
.../nutch/urlfilter/prefix/PrefixURLFilter.html | 12 +-
.../prefix/class-use/PrefixURLFilter.html | 12 +-
.../nutch/urlfilter/prefix/package-summary.html | 12 +-
.../nutch/urlfilter/prefix/package-tree.html | 12 +-
.../apache/nutch/urlfilter/prefix/package-use.html | 12 +-
.../nutch/urlfilter/regex/RegexURLFilter.html | 12 +-
.../urlfilter/regex/class-use/RegexURLFilter.html | 17 +-
.../nutch/urlfilter/regex/package-summary.html | 12 +-
.../apache/nutch/urlfilter/regex/package-tree.html | 12 +-
.../apache/nutch/urlfilter/regex/package-use.html | 12 +-
.../nutch/urlfilter/suffix/SuffixURLFilter.html | 12 +-
.../suffix/class-use/SuffixURLFilter.html | 12 +-
.../nutch/urlfilter/suffix/package-summary.html | 12 +-
.../nutch/urlfilter/suffix/package-tree.html | 12 +-
.../apache/nutch/urlfilter/suffix/package-use.html | 12 +-
.../nutch/urlfilter/validator/UrlValidator.html | 12 +-
.../validator/class-use/UrlValidator.html | 12 +-
.../nutch/urlfilter/validator/package-summary.html | 12 +-
.../nutch/urlfilter/validator/package-tree.html | 12 +-
.../nutch/urlfilter/validator/package-use.html | 12 +-
.../api/org/apache/nutch/util/AbstractChecker.html | 12 +-
.../api/org/apache/nutch/util/CommandRunner.html | 12 +-
...mpletionStats.CrawlCompletionStatsCombiner.html | 12 +-
.../apache/nutch/util/CrawlCompletionStats.html | 12 +-
.../api/org/apache/nutch/util/DeflateUtils.html | 12 +-
.../javadoc/api/org/apache/nutch/util/DomUtil.html | 12 +-
.../DomainStatistics.DomainStatisticsCombiner.html | 56 +-
.../{domain => }/DomainStatistics.MyCounter.html | 76 +-
.../nutch/util/{domain => }/DomainStatistics.html | 58 +-
.../api/org/apache/nutch/util/DumpFileUtil.html | 12 +-
.../org/apache/nutch/util/EncodingDetector.html | 12 +-
.../javadoc/api/org/apache/nutch/util/FSUtils.html | 12 +-
.../api/org/apache/nutch/util/GZIPUtils.html | 12 +-
.../nutch/util/GenericWritableConfigurable.html | 12 +-
.../api/org/apache/nutch/util/HadoopFSUtil.html | 12 +-
.../api/org/apache/nutch/util/JexlUtil.html | 12 +-
.../api/org/apache/nutch/util/LockUtil.html | 12 +-
.../api/org/apache/nutch/util/MimeUtil.html | 12 +-
.../api/org/apache/nutch/util/NodeWalker.html | 12 +-
.../org/apache/nutch/util/NutchConfiguration.html | 12 +-
.../api/org/apache/nutch/util/NutchJob.html | 12 +-
.../api/org/apache/nutch/util/NutchTool.html | 12 +-
.../api/org/apache/nutch/util/ObjectCache.html | 12 +-
.../org/apache/nutch/util/PrefixStringMatcher.html | 12 +-
...tatistics.ProtocolStatusStatisticsCombiner.html | 12 +-
.../nutch/util/ProtocolStatusStatistics.html | 12 +-
.../org/apache/nutch/util/SegmentReaderUtil.html | 12 +-
.../org/apache/nutch/util/SitemapProcessor.html | 12 +-
.../api/org/apache/nutch/util/StringUtil.html | 12 +-
.../org/apache/nutch/util/SuffixStringMatcher.html | 12 +-
.../api/org/apache/nutch/util/TableUtil.html | 12 +-
.../api/org/apache/nutch/util/TimingUtil.html | 12 +-
.../nutch/util/TrieStringMatcher.TrieNode.html | 12 +-
.../org/apache/nutch/util/TrieStringMatcher.html | 14 +-
.../javadoc/api/org/apache/nutch/util/URLUtil.html | 176 +++--
.../nutch/util/class-use/AbstractChecker.html | 12 +-
.../apache/nutch/util/class-use/CommandRunner.html | 12 +-
...mpletionStats.CrawlCompletionStatsCombiner.html | 12 +-
.../nutch/util/class-use/CrawlCompletionStats.html | 12 +-
.../apache/nutch/util/class-use/DeflateUtils.html | 12 +-
.../org/apache/nutch/util/class-use/DomUtil.html | 12 +-
...DomainStatistics.DomainStatisticsCombiner.html} | 20 +-
...tCache.html => DomainStatistics.MyCounter.html} | 40 +-
...EncodingDetector.html => DomainStatistics.html} | 20 +-
.../apache/nutch/util/class-use/DumpFileUtil.html | 12 +-
.../nutch/util/class-use/EncodingDetector.html | 12 +-
.../org/apache/nutch/util/class-use/FSUtils.html | 12 +-
.../org/apache/nutch/util/class-use/GZIPUtils.html | 12 +-
.../class-use/GenericWritableConfigurable.html | 12 +-
.../apache/nutch/util/class-use/HadoopFSUtil.html | 12 +-
.../org/apache/nutch/util/class-use/JexlUtil.html | 12 +-
.../org/apache/nutch/util/class-use/LockUtil.html | 12 +-
.../org/apache/nutch/util/class-use/MimeUtil.html | 12 +-
.../apache/nutch/util/class-use/NodeWalker.html | 12 +-
.../nutch/util/class-use/NutchConfiguration.html | 12 +-
.../org/apache/nutch/util/class-use/NutchJob.html | 12 +-
.../org/apache/nutch/util/class-use/NutchTool.html | 14 +-
.../apache/nutch/util/class-use/ObjectCache.html | 12 +-
.../nutch/util/class-use/PrefixStringMatcher.html | 12 +-
...tatistics.ProtocolStatusStatisticsCombiner.html | 12 +-
.../util/class-use/ProtocolStatusStatistics.html | 12 +-
.../nutch/util/class-use/SegmentReaderUtil.html | 12 +-
.../nutch/util/class-use/SitemapProcessor.html | 12 +-
.../apache/nutch/util/class-use/StringUtil.html | 12 +-
.../nutch/util/class-use/SuffixStringMatcher.html | 12 +-
.../org/apache/nutch/util/class-use/TableUtil.html | 12 +-
.../apache/nutch/util/class-use/TimingUtil.html | 12 +-
.../util/class-use/TrieStringMatcher.TrieNode.html | 12 +-
.../nutch/util/class-use/TrieStringMatcher.html | 12 +-
.../org/apache/nutch/util/class-use/URLUtil.html | 12 +-
.../nutch/util/domain/DomainSuffix.Status.html | 502 -------------
.../org/apache/nutch/util/domain/DomainSuffix.html | 478 ------------
.../apache/nutch/util/domain/DomainSuffixes.html | 331 --------
.../nutch/util/domain/TopLevelDomain.Type.html | 397 ----------
.../apache/nutch/util/domain/TopLevelDomain.html | 425 -----------
.../DomainStatistics.DomainStatisticsCombiner.html | 150 ----
.../class-use/DomainStatistics.MyCounter.html | 206 -----
.../util/domain/class-use/DomainStatistics.html | 150 ----
.../util/domain/class-use/DomainSuffix.Status.html | 255 -------
.../nutch/util/domain/class-use/DomainSuffix.html | 258 -------
.../util/domain/class-use/DomainSuffixes.html | 198 -----
.../util/domain/class-use/TopLevelDomain.Type.html | 227 ------
.../util/domain/class-use/TopLevelDomain.html | 150 ----
.../apache/nutch/util/domain/package-summary.html | 233 ------
.../org/apache/nutch/util/domain/package-tree.html | 196 -----
.../org/apache/nutch/util/domain/package-use.html | 237 ------
.../api/org/apache/nutch/util/package-summary.html | 37 +-
.../api/org/apache/nutch/util/package-tree.html | 28 +-
.../api/org/apache/nutch/util/package-use.html | 20 +-
.../creativecommons/nutch/CCIndexingFilter.html | 12 +-
.../nutch/CCParseFilter.Walker.html | 12 +-
.../org/creativecommons/nutch/CCParseFilter.html | 12 +-
.../nutch/class-use/CCIndexingFilter.html | 12 +-
.../nutch/class-use/CCParseFilter.Walker.html | 12 +-
.../nutch/class-use/CCParseFilter.html | 12 +-
.../org/creativecommons/nutch/package-summary.html | 12 +-
.../org/creativecommons/nutch/package-tree.html | 12 +-
.../api/org/creativecommons/nutch/package-use.html | 12 +-
.../javadoc/api/overview-summary.html | 4 +-
.../documentation/javadoc/api/overview-tree.html | 29 +-
.../javadoc/api/package-search-index.js | 2 +-
.../javadoc/api/package-search-index.zip | Bin 892 -> 884 bytes
.../javadoc/api/resources/nutch-default.xml | 58 +-
.../documentation/javadoc/api/serialized-form.html | 12 +-
.../documentation/javadoc/api/type-search-index.js | 2 +-
.../javadoc/api/type-search-index.zip | Bin 4268 -> 4220 bytes
content/news/nutch-1.21-release.md | 19 +
themes/kube/layouts/partials/footer.html | 2 +-
1312 files changed, 8923 insertions(+), 15030 deletions(-)
diff --git a/README.md b/README.md
index ccf2834..71cbfd3 100644
--- a/README.md
+++ b/README.md
@@ -6,6 +6,7 @@ Nutch Website
This repository contains the website source code for the [Apache Nutch](https://nutch.apache.org) project.
# Credits
+
Built using the [kube Theme for Hugo](https://github.com/jeblister/kube).
# Tooling
diff --git a/config.toml b/config.toml
index c79896a..8f7a548 100644
--- a/config.toml
+++ b/config.toml
@@ -17,7 +17,7 @@ unsafe = true # allow raw HTML in markdown content
github = "https://github.com/apache/nutch"
twitter = "@ApacheNutch"
email = "dev@nutch.apache.org"
- nutchVersion = "1.20"
+ nutchVersion = "1.21"
[[menu.main]]
name = "Community"
diff --git a/content/doap.rdf b/content/doap.rdf
index 0799f8f..81a5c90 100644
--- a/content/doap.rdf
+++ b/content/doap.rdf
@@ -34,6 +34,13 @@
<download-page rdf:resource="https://www.apache.org/dyn/closer.cgi/nutch/" />
<programming-language>Java</programming-language>
<category rdf:resource="http://projects.apache.org/category/web-framework" />
+ <release>
+ <Version>
+ <name>Apache Nutch 1.21</name>
+ <created>2025-07-20</created>
+ <revision>1.21</revision>
+ </Version>
+ </release>
<release>
<Version>
<name>Apache Nutch 1.20</name>
diff --git a/content/documentation/javadoc/api/allclasses-index.html b/content/documentation/javadoc/api/allclasses-index.html
index c4c4b0f..7071f9a 100644
--- a/content/documentation/javadoc/api/allclasses-index.html
+++ b/content/documentation/javadoc/api/allclasses-index.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>All Classes (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>All Classes (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,20 +15,20 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="All Classes (apache-nutch 1.20 API)";
+ parent.document.title="All Classes (apache-nutch 1.21 API)";
}
}
catch(err) {
}
//-->
-var data = {"i0":2,"i1":2,"i2":2,"i3":2,"i4":2,"i5":2,"i6":2,"i7":2,"i8":2,"i9":2,"i10":2,"i11":2,"i12":2,"i13":2,"i14":2,"i15":2,"i16":2,"i17":8,"i18":2,"i19":2,"i20":2,"i21":2,"i22":2,"i23":8,"i24":2,"i25":2,"i26":2,"i27":2,"i28":2,"i29":1,"i30":2,"i31":2,"i32":2,"i33":2,"i34":2,"i35":2,"i36":1,"i37":2,"i38":2,"i39":2,"i40":2,"i41":2,"i42":2,"i43":1,"i44":2,"i45":2,"i46":2,"i47":2,"i48":2,"i49":2,"i50":2,"i51":2,"i52":1,"i53":2,"i54":2,"i55":2,"i56":2,"i57":2,"i58":2,"i59":2,"i60":2,"i [...]
+var data = {"i0":2,"i1":2,"i2":2,"i3":2,"i4":2,"i5":2,"i6":2,"i7":2,"i8":2,"i9":2,"i10":2,"i11":2,"i12":2,"i13":2,"i14":2,"i15":2,"i16":2,"i17":8,"i18":2,"i19":2,"i20":2,"i21":2,"i22":2,"i23":8,"i24":2,"i25":2,"i26":2,"i27":2,"i28":2,"i29":1,"i30":2,"i31":2,"i32":2,"i33":2,"i34":2,"i35":2,"i36":1,"i37":2,"i38":2,"i39":2,"i40":2,"i41":2,"i42":2,"i43":1,"i44":2,"i45":2,"i46":2,"i47":2,"i48":2,"i49":2,"i50":2,"i51":2,"i52":1,"i53":2,"i54":2,"i55":2,"i56":2,"i57":2,"i58":2,"i59":2,"i60":2,"i [...]
var tabs = {65535:["t0","All Classes"],1:["t1","Interface Summary"],2:["t2","Class Summary"],4:["t3","Enum Summary"],8:["t4","Exception Summary"]};
var altColor = "altColor";
var rowColor = "rowColor";
@@ -603,40 +603,20 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</th>
</tr>
<tr id="i89" class="rowColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/DomainStatistics.html" title="class in org.apache.nutch.util.domain">DomainStatistics</a></td>
+<td class="colFirst"><a href="org/apache/nutch/util/DomainStatistics.html" title="class in org.apache.nutch.util">DomainStatistics</a></td>
<th class="colLast" scope="row">
<div class="block">Extracts some very basic statistics about domains from the crawldb</div>
</th>
</tr>
<tr id="i90" class="altColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util.domain">DomainStatistics.DomainStatisticsCombiner</a></td>
+<td class="colFirst"><a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util">DomainStatistics.DomainStatisticsCombiner</a></td>
<th class="colLast" scope="row"> </th>
</tr>
<tr id="i91" class="rowColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></td>
+<td class="colFirst"><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
<tr id="i92" class="altColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></td>
-<th class="colLast" scope="row">
-<div class="block">This class represents the last part of the host name, which is operated by
- authoritives, not individuals.</div>
-</th>
-</tr>
-<tr id="i93" class="rowColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></td>
-<th class="colLast" scope="row">
-<div class="block">Enumeration of the status of the tld.</div>
-</th>
-</tr>
-<tr id="i94" class="altColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/DomainSuffixes.html" title="class in org.apache.nutch.util.domain">DomainSuffixes</a></td>
-<th class="colLast" scope="row">
-<div class="block">Storage class for <code>DomainSuffix</code> objects Note: this class is
- singleton</div>
-</th>
-</tr>
-<tr id="i95" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/domain/DomainURLFilter.html" title="class in org.apache.nutch.urlfilter.domain">DomainURLFilter</a></td>
<th class="colLast" scope="row">
<div class="block">
@@ -644,113 +624,114 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
hostnames.</div>
</th>
</tr>
-<tr id="i96" class="altColor">
+<tr id="i93" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/html/DOMBuilder.html" title="class in org.apache.nutch.parse.html">DOMBuilder</a></td>
<th class="colLast" scope="row">
<div class="block">This class takes SAX events (in addition to some extra events that SAX
doesn't handle yet) and adds the result to a document or document fragment.</div>
</th>
</tr>
-<tr id="i97" class="rowColor">
+<tr id="i94" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/html/DOMContentUtils.html" title="class in org.apache.nutch.parse.html">DOMContentUtils</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of methods for extracting content from DOM trees.</div>
</th>
</tr>
-<tr id="i98" class="altColor">
+<tr id="i95" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/tika/DOMContentUtils.html" title="class in org.apache.nutch.parse.tika">DOMContentUtils</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of methods for extracting content from DOM trees.</div>
</th>
</tr>
-<tr id="i99" class="rowColor">
+<tr id="i96" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/html/DOMContentUtils.LinkParams.html" title="class in org.apache.nutch.parse.html">DOMContentUtils.LinkParams</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i100" class="altColor">
+<tr id="i97" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/DomUtil.html" title="class in org.apache.nutch.util">DomUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i101" class="rowColor">
+<tr id="i98" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/DublinCore.html" title="interface in org.apache.nutch.metadata">DublinCore</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of Dublin Core metadata names.</div>
</th>
</tr>
-<tr id="i102" class="altColor">
+<tr id="i99" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/dummy/DummyConstants.html" title="interface in org.apache.nutch.indexwriter.dummy">DummyConstants</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i103" class="rowColor">
+<tr id="i100" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/dummy/DummyIndexWriter.html" title="class in org.apache.nutch.indexwriter.dummy">DummyIndexWriter</a></td>
<th class="colLast" scope="row">
<div class="block">DummyIndexWriter.</div>
</th>
</tr>
-<tr id="i104" class="altColor">
+<tr id="i101" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/DummySSLProtocolSocketFactory.html" title="class in org.apache.nutch.protocol.httpclient">DummySSLProtocolSocketFactory</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i105" class="rowColor">
+<tr id="i102" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/htmlunit/DummyX509TrustManager.html" title="class in org.apache.nutch.protocol.htmlunit">DummyX509TrustManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i106" class="altColor">
+<tr id="i103" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/DummyX509TrustManager.html" title="class in org.apache.nutch.protocol.http">DummyX509TrustManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i107" class="rowColor">
+<tr id="i104" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/DummyX509TrustManager.html" title="class in org.apache.nutch.protocol.httpclient">DummyX509TrustManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i108" class="altColor">
+<tr id="i105" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/interactiveselenium/DummyX509TrustManager.html" title="class in org.apache.nutch.protocol.interactiveselenium">DummyX509TrustManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i109" class="rowColor">
+<tr id="i106" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/selenium/DummyX509TrustManager.html" title="class in org.apache.nutch.protocol.selenium">DummyX509TrustManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i110" class="altColor">
+<tr id="i107" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/DumpFileUtil.html" title="class in org.apache.nutch.util">DumpFileUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i111" class="rowColor">
+<tr id="i108" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/elastic/ElasticConstants.html" title="interface in org.apache.nutch.indexwriter.elastic">ElasticConstants</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i112" class="altColor">
+<tr id="i109" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/elastic/ElasticIndexWriter.html" title="class in org.apache.nutch.indexwriter.elastic">ElasticIndexWriter</a></td>
<th class="colLast" scope="row">
<div class="block">Sends NutchDocuments to a configured Elasticsearch index.</div>
</th>
</tr>
-<tr id="i113" class="rowColor">
+<tr id="i110" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/EncodingDetector.html" title="class in org.apache.nutch.util">EncodingDetector</a></td>
<th class="colLast" scope="row">
<div class="block">A simple class for detecting character encodings.</div>
</th>
</tr>
-<tr id="i114" class="altColor">
+<tr id="i111" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/exchange/Exchange.html" title="interface in org.apache.nutch.exchange">Exchange</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i115" class="rowColor">
+<tr id="i112" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/exchange/ExchangeConfig.html" title="class in org.apache.nutch.exchange">ExchangeConfig</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i116" class="altColor">
+<tr id="i113" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/exchange/Exchanges.html" title="class in org.apache.nutch.exchange">Exchanges</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i117" class="rowColor">
+<tr id="i114" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/ignoreexempt/ExemptionUrlFilter.html" title="class in org.apache.nutch.urlfilter.ignoreexempt">ExemptionUrlFilter</a></td>
<th class="colLast" scope="row">
-<div class="block">This implementation of <a href="org/apache/nutch/net/URLExemptionFilter.html" title="interface in org.apache.nutch.net"><code>URLExemptionFilter</code></a> uses regex configuration
- to check if URL is eligible for exemption from 'db.ignore.external'.</div>
+<div class="block">This implementation of <a href="org/apache/nutch/net/URLExemptionFilter.html" title="interface in org.apache.nutch.net"><code>URLExemptionFilter</code></a>
+ uses regex configuration to check if URL is eligible for exemption from
+ the <code>db.ignore.external.links</code> configuration property.</div>
</th>
</tr>
-<tr id="i118" class="altColor">
+<tr id="i115" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/Extension.html" title="class in org.apache.nutch.plugin">Extension</a></td>
<th class="colLast" scope="row">
<div class="block">An <code>Extension</code> is a kind of listener descriptor that will be
@@ -758,340 +739,340 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
Publisher.</div>
</th>
</tr>
-<tr id="i119" class="rowColor">
+<tr id="i116" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/ExtensionPoint.html" title="class in org.apache.nutch.plugin">ExtensionPoint</a></td>
<th class="colLast" scope="row">
<div class="block">The <code>ExtensionPoint</code> provide meta information of a extension
point.</div>
</th>
</tr>
-<tr id="i120" class="altColor">
+<tr id="i117" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ext/ExtParser.html" title="class in org.apache.nutch.parse.ext">ExtParser</a></td>
<th class="colLast" scope="row">
<div class="block">A wrapper that invokes external command to do real parsing job.</div>
</th>
</tr>
-<tr id="i121" class="rowColor">
+<tr id="i118" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Filters URLs based on a file of regular expressions using host/domains
matching first.</div>
</th>
</tr>
-<tr id="i122" class="altColor">
+<tr id="i119" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyAllRule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.DenyAllRule</a></td>
<th class="colLast" scope="row">
<div class="block">Rule for <code>DenyPath .*</code> or <code>DenyPath .?</code></div>
</th>
</tr>
-<tr id="i123" class="rowColor">
+<tr id="i120" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyPathQueryRule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.DenyPathQueryRule</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i124" class="altColor">
+<tr id="i121" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyPathRule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.DenyPathRule</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i125" class="rowColor">
+<tr id="i122" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.Rule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.Rule</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i126" class="altColor">
+<tr id="i123" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/Feed.html" title="interface in org.apache.nutch.metadata">Feed</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of Feed property names extracted by the ROME library.</div>
</th>
</tr>
-<tr id="i127" class="rowColor">
+<tr id="i124" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/feed/FeedIndexingFilter.html" title="class in org.apache.nutch.indexer.feed">FeedIndexingFilter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i128" class="altColor">
+<tr id="i125" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/feed/FeedParser.html" title="class in org.apache.nutch.parse.feed">FeedParser</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i129" class="rowColor">
+<tr id="i126" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/Fetcher.html" title="class in org.apache.nutch.fetcher">Fetcher</a></td>
<th class="colLast" scope="row">
<div class="block">A queue-based fetcher.</div>
</th>
</tr>
-<tr id="i130" class="altColor">
+<tr id="i127" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/Fetcher.FetcherRun.html" title="class in org.apache.nutch.fetcher">Fetcher.FetcherRun</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i131" class="rowColor">
+<tr id="i128" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/Fetcher.InputFormat.html" title="class in org.apache.nutch.fetcher">Fetcher.InputFormat</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i132" class="altColor">
+<tr id="i129" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetcherOutputFormat.html" title="class in org.apache.nutch.fetcher">FetcherOutputFormat</a></td>
<th class="colLast" scope="row">
<div class="block">Splits FetcherOutput entries into multiple map files.</div>
</th>
</tr>
-<tr id="i133" class="rowColor">
+<tr id="i130" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetcherThread.html" title="class in org.apache.nutch.fetcher">FetcherThread</a></td>
<th class="colLast" scope="row">
<div class="block">This class picks items from queues and fetches the pages.</div>
</th>
</tr>
-<tr id="i134" class="altColor">
+<tr id="i131" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetcherThreadEvent.html" title="class in org.apache.nutch.fetcher">FetcherThreadEvent</a></td>
<th class="colLast" scope="row">
<div class="block">This class is used to capture the various events occurring
at fetch time.</div>
</th>
</tr>
-<tr id="i135" class="rowColor">
+<tr id="i132" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetcherThreadEvent.PublishEventType.html" title="enum in org.apache.nutch.fetcher">FetcherThreadEvent.PublishEventType</a></td>
<th class="colLast" scope="row">
<div class="block">Type of event to specify start, end or reporting of a fetch item.</div>
</th>
</tr>
-<tr id="i136" class="altColor">
+<tr id="i133" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetcherThreadPublisher.html" title="class in org.apache.nutch.fetcher">FetcherThreadPublisher</a></td>
<th class="colLast" scope="row">
<div class="block">This class handles the publishing of the events to the queue implementation.</div>
</th>
</tr>
-<tr id="i137" class="rowColor">
+<tr id="i134" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetchItem.html" title="class in org.apache.nutch.fetcher">FetchItem</a></td>
<th class="colLast" scope="row">
<div class="block">This class describes the item to be fetched.</div>
</th>
</tr>
-<tr id="i138" class="altColor">
+<tr id="i135" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetchItemQueue.html" title="class in org.apache.nutch.fetcher">FetchItemQueue</a></td>
<th class="colLast" scope="row">
<div class="block">This class handles FetchItems which come from the same host ID (be it a
proto/hostname or proto/IP pair).</div>
</th>
</tr>
-<tr id="i139" class="rowColor">
+<tr id="i136" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetchItemQueues.html" title="class in org.apache.nutch.fetcher">FetchItemQueues</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of queues that keeps track of the total number of items, and
provides items eligible for fetching from any queue.</div>
</th>
</tr>
-<tr id="i140" class="altColor">
+<tr id="i137" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetchNode.html" title="class in org.apache.nutch.fetcher">FetchNode</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i141" class="rowColor">
+<tr id="i138" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/FetchNodeDb.html" title="class in org.apache.nutch.fetcher">FetchNodeDb</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i142" class="altColor">
+<tr id="i139" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/response/FetchNodeDbInfo.html" title="class in org.apache.nutch.service.model.response">FetchNodeDbInfo</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i143" class="rowColor">
+<tr id="i140" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/FetchOverdueCrawlDatumProcessor.html" title="class in org.apache.nutch.hostdb">FetchOverdueCrawlDatumProcessor</a></td>
<th class="colLast" scope="row">
<div class="block">Simple custom crawl datum processor that counts the number of records that
are overdue for fetching, e.g.</div>
</th>
</tr>
-<tr id="i144" class="altColor">
+<tr id="i141" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/FetchSchedule.html" title="interface in org.apache.nutch.crawl">FetchSchedule</a></td>
<th class="colLast" scope="row">
<div class="block">This interface defines the contract for implementations that manipulate fetch
times and re-fetch intervals.</div>
</th>
</tr>
-<tr id="i145" class="rowColor">
+<tr id="i142" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/FetchScheduleFactory.html" title="class in org.apache.nutch.crawl">FetchScheduleFactory</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches a <a href="org/apache/nutch/crawl/FetchSchedule.html" title="interface in org.apache.nutch.crawl"><code>FetchSchedule</code></a> implementation.</div>
</th>
</tr>
-<tr id="i146" class="altColor">
+<tr id="i143" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/replace/FieldReplacer.html" title="class in org.apache.nutch.indexer.replace">FieldReplacer</a></td>
<th class="colLast" scope="row">
<div class="block">POJO to store a filename, its match pattern and its replacement string.</div>
</th>
</tr>
-<tr id="i147" class="rowColor">
+<tr id="i144" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/file/File.html" title="class in org.apache.nutch.protocol.file">File</a></td>
<th class="colLast" scope="row">
<div class="block">This class is a protocol plugin used for file: scheme.</div>
</th>
</tr>
-<tr id="i148" class="altColor">
+<tr id="i145" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/FileDumper.html" title="class in org.apache.nutch.tools">FileDumper</a></td>
<th class="colLast" scope="row">
<div class="block">The file dumper tool enables one to reverse generate the raw content from
Nutch segment data directories.</div>
</th>
</tr>
-<tr id="i149" class="rowColor">
+<tr id="i146" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/file/FileError.html" title="class in org.apache.nutch.protocol.file">FileError</a></td>
<th class="colLast" scope="row">
<div class="block">Thrown for File error codes.</div>
</th>
</tr>
-<tr id="i150" class="altColor">
+<tr id="i147" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/file/FileException.html" title="class in org.apache.nutch.protocol.file">FileException</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i151" class="rowColor">
+<tr id="i148" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/file/FileResponse.html" title="class in org.apache.nutch.protocol.file">FileResponse</a></td>
<th class="colLast" scope="row">
<div class="block">FileResponse.java mimics file replies as http response.</div>
</th>
</tr>
-<tr id="i152" class="altColor">
+<tr id="i149" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/FreeGenerator.html" title="class in org.apache.nutch.tools">FreeGenerator</a></td>
<th class="colLast" scope="row">
<div class="block">This tool generates fetchlists (segments to be fetched) from plain text files
containing one URL per line.</div>
</th>
</tr>
-<tr id="i153" class="rowColor">
+<tr id="i150" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/tools/FreeGenerator.FG.html" title="class in org.apache.nutch.tools">FreeGenerator.FG</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i154" class="altColor">
+<tr id="i151" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/FreeGenerator.FG.FGMapper.html" title="class in org.apache.nutch.tools">FreeGenerator.FG.FGMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i155" class="rowColor">
+<tr id="i152" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/tools/FreeGenerator.FG.FGReducer.html" title="class in org.apache.nutch.tools">FreeGenerator.FG.FGReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i156" class="altColor">
+<tr id="i153" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/FSUtils.html" title="class in org.apache.nutch.util">FSUtils</a></td>
<th class="colLast" scope="row">
<div class="block">Utility methods for common filesystem operations.</div>
</th>
</tr>
-<tr id="i157" class="rowColor">
+<tr id="i154" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/Ftp.html" title="class in org.apache.nutch.protocol.ftp">Ftp</a></td>
<th class="colLast" scope="row">
<div class="block">This class is a protocol plugin used for ftp: scheme.</div>
</th>
</tr>
-<tr id="i158" class="altColor">
+<tr id="i155" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpError.html" title="class in org.apache.nutch.protocol.ftp">FtpError</a></td>
<th class="colLast" scope="row">
<div class="block">Thrown for Ftp error codes.</div>
</th>
</tr>
-<tr id="i159" class="rowColor">
+<tr id="i156" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpException.html" title="class in org.apache.nutch.protocol.ftp">FtpException</a></td>
<th class="colLast" scope="row">
<div class="block">Superclass for important exceptions thrown during FTP talk, that must be
handled with care.</div>
</th>
</tr>
-<tr id="i160" class="altColor">
+<tr id="i157" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpExceptionBadSystResponse.html" title="class in org.apache.nutch.protocol.ftp">FtpExceptionBadSystResponse</a></td>
<th class="colLast" scope="row">
<div class="block">Exception indicating bad reply of SYST command.</div>
</th>
</tr>
-<tr id="i161" class="rowColor">
+<tr id="i158" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpExceptionCanNotHaveDataConnection.html" title="class in org.apache.nutch.protocol.ftp">FtpExceptionCanNotHaveDataConnection</a></td>
<th class="colLast" scope="row">
<div class="block">Exception indicating failure of opening data connection.</div>
</th>
</tr>
-<tr id="i162" class="altColor">
+<tr id="i159" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpExceptionControlClosedByForcedDataClose.html" title="class in org.apache.nutch.protocol.ftp">FtpExceptionControlClosedByForcedDataClose</a></td>
<th class="colLast" scope="row">
<div class="block">Exception indicating control channel is closed by server end, due to forced
closure of data channel at client (our) end.</div>
</th>
</tr>
-<tr id="i163" class="rowColor">
+<tr id="i160" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpExceptionUnknownForcedDataClose.html" title="class in org.apache.nutch.protocol.ftp">FtpExceptionUnknownForcedDataClose</a></td>
<th class="colLast" scope="row">
<div class="block">Exception indicating unrecognizable reply from server after forced closure of
data channel by client (our) side.</div>
</th>
</tr>
-<tr id="i164" class="altColor">
+<tr id="i161" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpResponse.html" title="class in org.apache.nutch.protocol.ftp">FtpResponse</a></td>
<th class="colLast" scope="row">
<div class="block">FtpResponse.java mimics ftp replies as http response.</div>
</th>
</tr>
-<tr id="i165" class="rowColor">
+<tr id="i162" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/FtpRobotRulesParser.html" title="class in org.apache.nutch.protocol.ftp">FtpRobotRulesParser</a></td>
<th class="colLast" scope="row">
<div class="block">This class is used for parsing robots for urls belonging to FTP protocol.</div>
</th>
</tr>
-<tr id="i166" class="altColor">
+<tr id="i163" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.html" title="class in org.apache.nutch.crawl">Generator</a></td>
<th class="colLast" scope="row">
-<div class="block">Generates a subset of a crawl db to fetch.</div>
+<div class="block">Generates a subset of a CrawlDb to fetch.</div>
</th>
</tr>
-<tr id="i167" class="rowColor">
+<tr id="i164" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.CrawlDbUpdater.html" title="class in org.apache.nutch.crawl">Generator.CrawlDbUpdater</a></td>
<th class="colLast" scope="row">
<div class="block">Update the CrawlDB so that the next generate won't include the same URLs.</div>
</th>
</tr>
-<tr id="i168" class="altColor">
+<tr id="i165" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateMapper.html" title="class in org.apache.nutch.crawl">Generator.CrawlDbUpdater.CrawlDbUpdateMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i169" class="rowColor">
+<tr id="i166" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateReducer.html" title="class in org.apache.nutch.crawl">Generator.CrawlDbUpdater.CrawlDbUpdateReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i170" class="altColor">
+<tr id="i167" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.DecreasingFloatComparator.html" title="class in org.apache.nutch.crawl">Generator.DecreasingFloatComparator</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i171" class="rowColor">
+<tr id="i168" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.HashComparator.html" title="class in org.apache.nutch.crawl">Generator.HashComparator</a></td>
<th class="colLast" scope="row">
<div class="block">Sort fetch lists by hash of URL.</div>
</th>
</tr>
-<tr id="i172" class="altColor">
+<tr id="i169" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.PartitionReducer.html" title="class in org.apache.nutch.crawl">Generator.PartitionReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i173" class="rowColor">
+<tr id="i170" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.Selector.html" title="class in org.apache.nutch.crawl">Generator.Selector</a></td>
<th class="colLast" scope="row">
<div class="block">Selects entries due for fetch.</div>
</th>
</tr>
-<tr id="i174" class="altColor">
+<tr id="i171" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.SelectorEntry.html" title="class in org.apache.nutch.crawl">Generator.SelectorEntry</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i175" class="rowColor">
+<tr id="i172" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.SelectorInverseMapper.html" title="class in org.apache.nutch.crawl">Generator.SelectorInverseMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i176" class="altColor">
+<tr id="i173" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.SelectorMapper.html" title="class in org.apache.nutch.crawl">Generator.SelectorMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Select and invert subset due for fetch.</div>
</th>
</tr>
-<tr id="i177" class="rowColor">
+<tr id="i174" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Generator.SelectorReducer.html" title="class in org.apache.nutch.crawl">Generator.SelectorReducer</a></td>
<th class="colLast" scope="row">
<div class="block">Collect until limit is reached.</div>
</th>
</tr>
-<tr id="i178" class="altColor">
+<tr id="i175" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/GenericWritableConfigurable.html" title="class in org.apache.nutch.util">GenericWritableConfigurable</a></td>
<th class="colLast" scope="row">
<div class="block">A generic Writable wrapper that can inject Configuration to
<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/conf/Configurable.html?is-external=true" title="class or interface in org.apache.hadoop.conf" class="externalLink"><code>Configurable</code></a>s</div>
</th>
</tr>
-<tr id="i179" class="rowColor">
+<tr id="i176" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/geoip/GeoIPDocumentCreator.html" title="class in org.apache.nutch.indexer.geoip">GeoIPDocumentCreator</a></td>
<th class="colLast" scope="row">
<div class="block">
@@ -1100,94 +1081,94 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<a href="org/apache/nutch/indexer/geoip/GeoIPIndexingFilter.html" title="class in org.apache.nutch.indexer.geoip"><code>GeoIPIndexingFilter</code></a>, where configuration is also read.</div>
</th>
</tr>
-<tr id="i180" class="altColor">
+<tr id="i177" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/geoip/GeoIPIndexingFilter.html" title="class in org.apache.nutch.indexer.geoip">GeoIPIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">This plugin implements an indexing filter which takes advantage of the <a href="https://github.com/maxmind/GeoIP2-java">GeoIP2-java API</a>.</div>
</th>
</tr>
-<tr id="i181" class="rowColor">
+<tr id="i178" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/GZIPUtils.html" title="class in org.apache.nutch.util">GZIPUtils</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of utility methods for working on GZIPed data.</div>
</th>
</tr>
-<tr id="i182" class="altColor">
+<tr id="i179" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/HadoopFSUtil.html" title="class in org.apache.nutch.util">HadoopFSUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i183" class="rowColor">
+<tr id="i180" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/headings/HeadingsParseFilter.html" title="class in org.apache.nutch.parse.headings">HeadingsParseFilter</a></td>
<th class="colLast" scope="row">
<div class="block">HtmlParseFilter to retrieve h1 and h2 values from the DOM.</div>
</th>
</tr>
-<tr id="i184" class="altColor">
+<tr id="i181" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/HostDatum.html" title="class in org.apache.nutch.hostdb">HostDatum</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i185" class="rowColor">
+<tr id="i182" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/urlnormalizer/host/HostURLNormalizer.html" title="class in org.apache.nutch.net.urlnormalizer.host">HostURLNormalizer</a></td>
<th class="colLast" scope="row">
<div class="block">URL normalizer for mapping hosts to their desired form.</div>
</th>
</tr>
-<tr id="i186" class="altColor">
+<tr id="i183" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/analysis/lang/HTMLLanguageParser.html" title="class in org.apache.nutch.analysis.lang">HTMLLanguageParser</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i187" class="rowColor">
+<tr id="i184" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/html/HTMLMetaProcessor.html" title="class in org.apache.nutch.parse.html">HTMLMetaProcessor</a></td>
<th class="colLast" scope="row">
<div class="block">Class for parsing META Directives from DOM trees.</div>
</th>
</tr>
-<tr id="i188" class="altColor">
+<tr id="i185" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/tika/HTMLMetaProcessor.html" title="class in org.apache.nutch.parse.tika">HTMLMetaProcessor</a></td>
<th class="colLast" scope="row">
<div class="block">Class for parsing META Directives from DOM trees.</div>
</th>
</tr>
-<tr id="i189" class="rowColor">
+<tr id="i186" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/HTMLMetaTags.html" title="class in org.apache.nutch.parse">HTMLMetaTags</a></td>
<th class="colLast" scope="row">
<div class="block">This class holds the information about HTML "meta" tags extracted from a
page.</div>
</th>
</tr>
-<tr id="i190" class="altColor">
+<tr id="i187" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/HtmlParseFilter.html" title="interface in org.apache.nutch.parse">HtmlParseFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Extension point for DOM-based HTML parsers.</div>
</th>
</tr>
-<tr id="i191" class="rowColor">
+<tr id="i188" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/HtmlParseFilters.html" title="class in org.apache.nutch.parse">HtmlParseFilters</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/parse/HtmlParseFilter.html" title="interface in org.apache.nutch.parse"><code>HtmlParseFilter</code></a> implementing plugins.</div>
</th>
</tr>
-<tr id="i192" class="altColor">
+<tr id="i189" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/html/HtmlParser.html" title="class in org.apache.nutch.parse.html">HtmlParser</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i193" class="rowColor">
+<tr id="i190" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/htmlunit/HtmlUnitWebDriver.html" title="class in org.apache.nutch.protocol.htmlunit">HtmlUnitWebDriver</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i194" class="altColor">
+<tr id="i191" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/htmlunit/HtmlUnitWebWindowListener.html" title="class in org.apache.nutch.protocol.htmlunit">HtmlUnitWebWindowListener</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i195" class="rowColor">
+<tr id="i192" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/htmlunit/Http.html" title="class in org.apache.nutch.protocol.htmlunit">Http</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i196" class="altColor">
+<tr id="i193" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/Http.html" title="class in org.apache.nutch.protocol.http">Http</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i197" class="rowColor">
+<tr id="i194" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/Http.html" title="class in org.apache.nutch.protocol.httpclient">Http</a></td>
<th class="colLast" scope="row">
<div class="block">
@@ -1196,121 +1177,121 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
server.</div>
</th>
</tr>
-<tr id="i198" class="altColor">
+<tr id="i195" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/interactiveselenium/Http.html" title="class in org.apache.nutch.protocol.interactiveselenium">Http</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i199" class="rowColor">
+<tr id="i196" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/selenium/Http.html" title="class in org.apache.nutch.protocol.selenium">Http</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i200" class="altColor">
+<tr id="i197" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpAuthentication.html" title="interface in org.apache.nutch.protocol.httpclient">HttpAuthentication</a></td>
<th class="colLast" scope="row">
<div class="block">The base level of services required for Http Authentication</div>
</th>
</tr>
-<tr id="i201" class="rowColor">
+<tr id="i198" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpAuthenticationException.html" title="class in org.apache.nutch.protocol.httpclient">HttpAuthenticationException</a></td>
<th class="colLast" scope="row">
<div class="block">Can be used to identify problems during creation of Authentication objects.</div>
</th>
</tr>
-<tr id="i202" class="altColor">
+<tr id="i199" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpAuthenticationFactory.html" title="class in org.apache.nutch.protocol.httpclient">HttpAuthenticationFactory</a></td>
<th class="colLast" scope="row">
<div class="block">Provides the Http protocol implementation with the ability to authenticate
when prompted.</div>
</th>
</tr>
-<tr id="i203" class="rowColor">
+<tr id="i200" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/api/HttpBase.html" title="class in org.apache.nutch.protocol.http.api">HttpBase</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i204" class="altColor">
+<tr id="i201" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpBasicAuthentication.html" title="class in org.apache.nutch.protocol.httpclient">HttpBasicAuthentication</a></td>
<th class="colLast" scope="row">
<div class="block">Implementation of RFC 2617 Basic Authentication.</div>
</th>
</tr>
-<tr id="i205" class="rowColor">
+<tr id="i202" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/protocols/HttpDateFormat.html" title="class in org.apache.nutch.net.protocols">HttpDateFormat</a></td>
<th class="colLast" scope="row">
<div class="block">Parse and format HTTP dates in HTTP headers, e.g., used to fill the
"If-Modified-Since" request header field.</div>
</th>
</tr>
-<tr id="i206" class="altColor">
+<tr id="i203" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/api/HttpException.html" title="class in org.apache.nutch.protocol.http.api">HttpException</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i207" class="rowColor">
+<tr id="i204" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpFormAuthConfigurer.html" title="class in org.apache.nutch.protocol.httpclient">HttpFormAuthConfigurer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i208" class="altColor">
+<tr id="i205" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpFormAuthentication.html" title="class in org.apache.nutch.protocol.httpclient">HttpFormAuthentication</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i209" class="rowColor">
+<tr id="i206" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/HttpHeaders.html" title="interface in org.apache.nutch.metadata">HttpHeaders</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of HTTP header names.</div>
</th>
</tr>
-<tr id="i210" class="altColor">
+<tr id="i207" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/htmlunit/HttpResponse.html" title="class in org.apache.nutch.protocol.htmlunit">HttpResponse</a></td>
<th class="colLast" scope="row">
<div class="block">An HTTP response.</div>
</th>
</tr>
-<tr id="i211" class="rowColor">
+<tr id="i208" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/HttpResponse.html" title="class in org.apache.nutch.protocol.http">HttpResponse</a></td>
<th class="colLast" scope="row">
<div class="block">An HTTP response.</div>
</th>
</tr>
-<tr id="i212" class="altColor">
+<tr id="i209" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/httpclient/HttpResponse.html" title="class in org.apache.nutch.protocol.httpclient">HttpResponse</a></td>
<th class="colLast" scope="row">
<div class="block">An HTTP response.</div>
</th>
</tr>
-<tr id="i213" class="rowColor">
+<tr id="i210" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/interactiveselenium/HttpResponse.html" title="class in org.apache.nutch.protocol.interactiveselenium">HttpResponse</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i214" class="altColor">
+<tr id="i211" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/selenium/HttpResponse.html" title="class in org.apache.nutch.protocol.selenium">HttpResponse</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i215" class="rowColor">
+<tr id="i212" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/htmlunit/HttpResponse.Scheme.html" title="enum in org.apache.nutch.protocol.htmlunit">HttpResponse.Scheme</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i216" class="altColor">
+<tr id="i213" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/HttpResponse.Scheme.html" title="enum in org.apache.nutch.protocol.http">HttpResponse.Scheme</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i217" class="rowColor">
+<tr id="i214" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/interactiveselenium/HttpResponse.Scheme.html" title="enum in org.apache.nutch.protocol.interactiveselenium">HttpResponse.Scheme</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i218" class="altColor">
+<tr id="i215" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/selenium/HttpResponse.Scheme.html" title="enum in org.apache.nutch.protocol.selenium">HttpResponse.Scheme</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i219" class="rowColor">
+<tr id="i216" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/http/api/HttpRobotRulesParser.html" title="class in org.apache.nutch.protocol.http.api">HttpRobotRulesParser</a></td>
<th class="colLast" scope="row">
<div class="block">This class is used for parsing robots for urls belonging to HTTP protocol.</div>
</th>
</tr>
-<tr id="i220" class="altColor">
+<tr id="i217" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/selenium/HttpWebClient.html" title="class in org.apache.nutch.protocol.selenium">HttpWebClient</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i221" class="rowColor">
+<tr id="i218" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexerMapReduce.html" title="class in org.apache.nutch.indexer">IndexerMapReduce</a></td>
<th class="colLast" scope="row">
<div class="block">
@@ -1319,72 +1300,72 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
functionality required when undertaking indexing.</div>
</th>
</tr>
-<tr id="i222" class="altColor">
+<tr id="i219" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexerMapReduce.IndexerMapper.html" title="class in org.apache.nutch.indexer">IndexerMapReduce.IndexerMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i223" class="rowColor">
+<tr id="i220" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexerMapReduce.IndexerReducer.html" title="class in org.apache.nutch.indexer">IndexerMapReduce.IndexerReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i224" class="altColor">
+<tr id="i221" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexerOutputFormat.html" title="class in org.apache.nutch.indexer">IndexerOutputFormat</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i225" class="rowColor">
+<tr id="i222" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexingException.html" title="class in org.apache.nutch.indexer">IndexingException</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i226" class="altColor">
+<tr id="i223" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer">IndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Extension point for indexing.</div>
</th>
</tr>
-<tr id="i227" class="rowColor">
+<tr id="i224" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexingFilters.html" title="class in org.apache.nutch.indexer">IndexingFilters</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer"><code>IndexingFilter</code></a> implementing plugins.</div>
</th>
</tr>
-<tr id="i228" class="altColor">
+<tr id="i225" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexingFiltersChecker.html" title="class in org.apache.nutch.indexer">IndexingFiltersChecker</a></td>
<th class="colLast" scope="row">
<div class="block">Reads and parses a URL and run the indexers on it.</div>
</th>
</tr>
-<tr id="i229" class="rowColor">
+<tr id="i226" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexingJob.html" title="class in org.apache.nutch.indexer">IndexingJob</a></td>
<th class="colLast" scope="row">
<div class="block">Generic indexer which relies on the plugins implementing IndexWriter</div>
</th>
</tr>
-<tr id="i230" class="altColor">
+<tr id="i227" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexWriter.html" title="interface in org.apache.nutch.indexer">IndexWriter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i231" class="rowColor">
+<tr id="i228" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexWriterConfig.html" title="class in org.apache.nutch.indexer">IndexWriterConfig</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i232" class="altColor">
+<tr id="i229" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexWriterParams.html" title="class in org.apache.nutch.indexer">IndexWriterParams</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i233" class="rowColor">
+<tr id="i230" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/IndexWriters.html" title="class in org.apache.nutch.indexer">IndexWriters</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/indexer/IndexWriter.html" title="interface in org.apache.nutch.indexer"><code>IndexWriter</code></a> implementing plugins.</div>
</th>
</tr>
-<tr id="i234" class="altColor">
+<tr id="i231" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Injector.html" title="class in org.apache.nutch.crawl">Injector</a></td>
<th class="colLast" scope="row">
<div class="block">Injector takes a flat text file of URLs (or a folder containing text files)
and merges ("injects") these URLs into the CrawlDb.</div>
</th>
</tr>
-<tr id="i235" class="rowColor">
+<tr id="i232" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Injector.InjectMapper.html" title="class in org.apache.nutch.crawl">Injector.InjectMapper</a></td>
<th class="colLast" scope="row">
<div class="block">InjectMapper reads
@@ -1394,29 +1375,29 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
metadata.</div>
</th>
</tr>
-<tr id="i236" class="altColor">
+<tr id="i233" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Injector.InjectReducer.html" title="class in org.apache.nutch.crawl">Injector.InjectReducer</a></td>
<th class="colLast" scope="row">
<div class="block">Combine multiple new entries for a url.</div>
</th>
</tr>
-<tr id="i237" class="rowColor">
+<tr id="i234" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Inlink.html" title="class in org.apache.nutch.crawl">Inlink</a></td>
<th class="colLast" scope="row">
<div class="block">An incoming link to a page.</div>
</th>
</tr>
-<tr id="i238" class="altColor">
+<tr id="i235" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Inlinks.html" title="class in org.apache.nutch.crawl">Inlinks</a></td>
<th class="colLast" scope="row">
<div class="block">A list of <a href="org/apache/nutch/crawl/Inlink.html" title="class in org.apache.nutch.crawl"><code>Inlink</code></a>s.</div>
</th>
</tr>
-<tr id="i239" class="rowColor">
+<tr id="i236" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/interactiveselenium/handlers/InteractiveSeleniumHandler.html" title="interface in org.apache.nutch.protocol.interactiveselenium.handlers">InteractiveSeleniumHandler</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i240" class="altColor">
+<tr id="i237" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/okhttp/IPFilterRules.html" title="class in org.apache.nutch.protocol.okhttp">IPFilterRules</a></td>
<th class="colLast" scope="row">
<div class="block">Optionally limit or block connections to IP address ranges
@@ -1424,247 +1405,247 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
notation, or single IP addresses).</div>
</th>
</tr>
-<tr id="i241" class="rowColor">
+<tr id="i238" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/exchange/jexl/JexlExchange.html" title="class in org.apache.nutch.exchange.jexl">JexlExchange</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i242" class="altColor">
+<tr id="i239" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/jexl/JexlIndexingFilter.html" title="class in org.apache.nutch.indexer.jexl">JexlIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">An <a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer"><code>IndexingFilter</code></a> that allows filtering of
documents based on a JEXL expression.</div>
</th>
</tr>
-<tr id="i243" class="rowColor">
+<tr id="i240" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/JexlUtil.html" title="class in org.apache.nutch.util">JexlUtil</a></td>
<th class="colLast" scope="row">
<div class="block">Utility methods for handling JEXL expressions</div>
</th>
</tr>
-<tr id="i244" class="altColor">
+<tr id="i241" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/request/JobConfig.html" title="class in org.apache.nutch.service.model.request">JobConfig</a></td>
<th class="colLast" scope="row">
<div class="block">Job-specific configuration.</div>
</th>
</tr>
-<tr id="i245" class="rowColor">
+<tr id="i242" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/JobFactory.html" title="class in org.apache.nutch.service.impl">JobFactory</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i246" class="altColor">
+<tr id="i243" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/response/JobInfo.html" title="class in org.apache.nutch.service.model.response">JobInfo</a></td>
<th class="colLast" scope="row">
<div class="block">This is the response object containing Job information</div>
</th>
</tr>
-<tr id="i247" class="rowColor">
+<tr id="i244" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/response/JobInfo.State.html" title="enum in org.apache.nutch.service.model.response">JobInfo.State</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i248" class="altColor">
+<tr id="i245" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/JobManager.html" title="interface in org.apache.nutch.service">JobManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i249" class="rowColor">
+<tr id="i246" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/JobManager.JobType.html" title="enum in org.apache.nutch.service">JobManager.JobType</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i250" class="altColor">
+<tr id="i247" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/JobManagerImpl.html" title="class in org.apache.nutch.service.impl">JobManagerImpl</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i251" class="rowColor">
+<tr id="i248" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/resources/JobResource.html" title="class in org.apache.nutch.service.resources">JobResource</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i252" class="altColor">
+<tr id="i249" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/JobWorker.html" title="class in org.apache.nutch.service.impl">JobWorker</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i253" class="rowColor">
+<tr id="i250" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/js/JSParseFilter.html" title="class in org.apache.nutch.parse.js">JSParseFilter</a></td>
<th class="colLast" scope="row">
<div class="block">This class is a heuristic link extractor for JavaScript files and code
snippets.</div>
</th>
</tr>
-<tr id="i254" class="altColor">
+<tr id="i251" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/kafka/KafkaConstants.html" title="interface in org.apache.nutch.indexwriter.kafka">KafkaConstants</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i255" class="rowColor">
+<tr id="i252" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/kafka/KafkaIndexWriter.html" title="class in org.apache.nutch.indexwriter.kafka">KafkaIndexWriter</a></td>
<th class="colLast" scope="row">
<div class="block">Sends Nutch documents to a configured Kafka Cluster</div>
</th>
</tr>
-<tr id="i256" class="altColor">
+<tr id="i253" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/analysis/lang/LanguageIndexingFilter.html" title="class in org.apache.nutch.analysis.lang">LanguageIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">An <a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer"><code>IndexingFilter</code></a> that add a
<code>lang</code> (language) field to the document.</div>
</th>
</tr>
-<tr id="i257" class="rowColor">
+<tr id="i254" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/link/LinkAnalysisScoringFilter.html" title="class in org.apache.nutch.scoring.link">LinkAnalysisScoringFilter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i258" class="altColor">
+<tr id="i255" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDatum.html" title="class in org.apache.nutch.scoring.webgraph">LinkDatum</a></td>
<th class="colLast" scope="row">
<div class="block">A class for holding link information including the url, anchor text, a score,
the timestamp of the link and a link type.</div>
</th>
</tr>
-<tr id="i259" class="rowColor">
+<tr id="i256" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDb.html" title="class in org.apache.nutch.crawl">LinkDb</a></td>
<th class="colLast" scope="row">
<div class="block">Maintains an inverted link map, listing incoming links for each url.</div>
</th>
</tr>
-<tr id="i260" class="altColor">
+<tr id="i257" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDb.LinkDbMapper.html" title="class in org.apache.nutch.crawl">LinkDb.LinkDbMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i261" class="rowColor">
+<tr id="i258" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDbFilter.html" title="class in org.apache.nutch.crawl">LinkDbFilter</a></td>
<th class="colLast" scope="row">
<div class="block">This class provides a way to separate the URL normalization and filtering
steps from the rest of LinkDb manipulation code.</div>
</th>
</tr>
-<tr id="i262" class="altColor">
+<tr id="i259" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDbMerger.html" title="class in org.apache.nutch.crawl">LinkDbMerger</a></td>
<th class="colLast" scope="row">
<div class="block">This tool merges several LinkDb-s into one, optionally filtering URLs through
the current URLFilters, to skip prohibited URLs and links.</div>
</th>
</tr>
-<tr id="i263" class="rowColor">
+<tr id="i260" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDbMerger.LinkDbMergeReducer.html" title="class in org.apache.nutch.crawl">LinkDbMerger.LinkDbMergeReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i264" class="altColor">
+<tr id="i261" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDbReader.html" title="class in org.apache.nutch.crawl">LinkDbReader</a></td>
<th class="colLast" scope="row">
<div class="block">Read utility for the LinkDb.</div>
</th>
</tr>
-<tr id="i265" class="rowColor">
+<tr id="i262" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/LinkDbReader.LinkDBDumpMapper.html" title="class in org.apache.nutch.crawl">LinkDbReader.LinkDBDumpMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i266" class="altColor">
+<tr id="i263" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper</a></td>
<th class="colLast" scope="row">
<div class="block">The LinkDumper tool creates a database of node to inlink information that can
be read using the nested Reader class.</div>
</th>
</tr>
-<tr id="i267" class="rowColor">
+<tr id="i264" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.Inverter.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.Inverter</a></td>
<th class="colLast" scope="row">
<div class="block">Inverts outlinks from the WebGraph to inlinks and attaches node
information.</div>
</th>
</tr>
-<tr id="i268" class="altColor">
+<tr id="i265" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.Inverter.InvertMapper.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.Inverter.InvertMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Wraps all values in ObjectWritables.</div>
</th>
</tr>
-<tr id="i269" class="rowColor">
+<tr id="i266" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.Inverter.InvertReducer.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.Inverter.InvertReducer</a></td>
<th class="colLast" scope="row">
<div class="block">Inverts outlinks to inlinks while attaching node information to the
outlink.</div>
</th>
</tr>
-<tr id="i270" class="altColor">
+<tr id="i267" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.LinkNode.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.LinkNode</a></td>
<th class="colLast" scope="row">
<div class="block">Bean class which holds url to node information.</div>
</th>
</tr>
-<tr id="i271" class="rowColor">
+<tr id="i268" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.LinkNodes.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.LinkNodes</a></td>
<th class="colLast" scope="row">
<div class="block">Writable class which holds an array of LinkNode objects.</div>
</th>
</tr>
-<tr id="i272" class="altColor">
+<tr id="i269" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.Merger.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.Merger</a></td>
<th class="colLast" scope="row">
<div class="block">Merges LinkNode objects into a single array value per url.</div>
</th>
</tr>
-<tr id="i273" class="rowColor">
+<tr id="i270" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkDumper.Reader.html" title="class in org.apache.nutch.scoring.webgraph">LinkDumper.Reader</a></td>
<th class="colLast" scope="row">
<div class="block">Reader class which will print out the url and all of its inlinks to system
out.</div>
</th>
</tr>
-<tr id="i274" class="altColor">
+<tr id="i271" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/LinkRank.html" title="class in org.apache.nutch.scoring.webgraph">LinkRank</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i275" class="rowColor">
+<tr id="i272" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/LinkReader.html" title="class in org.apache.nutch.service.impl">LinkReader</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i276" class="altColor">
+<tr id="i273" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/links/LinksIndexingFilter.html" title="class in org.apache.nutch.indexer.links">LinksIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">An <a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer"><code>IndexingFilter</code></a> that adds
<code>outlinks</code> and <code>inlinks</code> field(s) to the document.</div>
</th>
</tr>
-<tr id="i277" class="rowColor">
+<tr id="i274" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/LockUtil.html" title="class in org.apache.nutch.util">LockUtil</a></td>
<th class="colLast" scope="row">
<div class="block">Utility methods for handling application-level locking.</div>
</th>
</tr>
-<tr id="i278" class="altColor">
+<tr id="i275" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/util/LuceneAnalyzerUtil.html" title="class in org.apache.nutch.scoring.similarity.util">LuceneAnalyzerUtil</a></td>
<th class="colLast" scope="row">
<div class="block">Creates a custom analyzer based on user provided inputs</div>
</th>
</tr>
-<tr id="i279" class="rowColor">
+<tr id="i276" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/util/LuceneAnalyzerUtil.StemFilterType.html" title="enum in org.apache.nutch.scoring.similarity.util">LuceneAnalyzerUtil.StemFilterType</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i280" class="altColor">
+<tr id="i277" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/util/LuceneTokenizer.html" title="class in org.apache.nutch.scoring.similarity.util">LuceneTokenizer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i281" class="rowColor">
+<tr id="i278" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/util/LuceneTokenizer.TokenizerType.html" title="enum in org.apache.nutch.scoring.similarity.util">LuceneTokenizer.TokenizerType</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i282" class="altColor">
+<tr id="i279" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/MD5Signature.html" title="class in org.apache.nutch.crawl">MD5Signature</a></td>
<th class="colLast" scope="row">
<div class="block">Default implementation of a page signature.</div>
</th>
</tr>
-<tr id="i283" class="rowColor">
+<tr id="i280" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/Metadata.html" title="class in org.apache.nutch.metadata">Metadata</a></td>
<th class="colLast" scope="row">
<div class="block">A multi-valued metadata container.</div>
</th>
</tr>
-<tr id="i284" class="altColor">
+<tr id="i281" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/metadata/MetadataIndexer.html" title="class in org.apache.nutch.indexer.metadata">MetadataIndexer</a></td>
<th class="colLast" scope="row">
<div class="block">Indexer which can be configured to extract metadata from the crawldb, parse
metadata or content metadata.</div>
</th>
</tr>
-<tr id="i285" class="rowColor">
+<tr id="i282" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/metadata/MetadataScoringFilter.html" title="class in org.apache.nutch.scoring.metadata">MetadataScoringFilter</a></td>
<th class="colLast" scope="row">
<div class="block">For documentation:
@@ -1672,7 +1653,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<a href="org/apache/nutch/scoring/metadata/package-summary.html"><code>org.apache.nutch.scoring.metadata</code></a></div>
</th>
</tr>
-<tr id="i286" class="altColor">
+<tr id="i283" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/metatags/MetaTagsParser.html" title="class in org.apache.nutch.parse.metatags">MetaTagsParser</a></td>
<th class="colLast" scope="row">
<div class="block">Parse HTML meta tags (keywords, description) and store them in the parse
@@ -1680,55 +1661,55 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
prefix 'metatag.'.</div>
</th>
</tr>
-<tr id="i287" class="rowColor">
+<tr id="i284" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/MetaWrapper.html" title="class in org.apache.nutch.metadata">MetaWrapper</a></td>
<th class="colLast" scope="row">
<div class="block">This is a simple decorator that adds metadata to any Writable-s that can be
serialized by <a href="org/apache/nutch/crawl/NutchWritable.html" title="class in org.apache.nutch.crawl"><code>NutchWritable</code></a>.</div>
</th>
</tr>
-<tr id="i288" class="altColor">
+<tr id="i285" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/MimeAdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">MimeAdaptiveFetchSchedule</a></td>
<th class="colLast" scope="row">
<div class="block">Extension of @see AdaptiveFetchSchedule that allows for more flexible
configuration of DEC and INC factors for various MIME-types.</div>
</th>
</tr>
-<tr id="i289" class="rowColor">
+<tr id="i286" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/filter/MimeTypeIndexingFilter.html" title="class in org.apache.nutch.indexer.filter">MimeTypeIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">An <a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer"><code>IndexingFilter</code></a> that allows filtering
of documents based on the MIME Type detected by Tika</div>
</th>
</tr>
-<tr id="i290" class="altColor">
+<tr id="i287" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/MimeUtil.html" title="class in org.apache.nutch.util">MimeUtil</a></td>
<th class="colLast" scope="row">
<div class="block">This is a facade class to insulate Nutch from its underlying Mime Type
substrate library, <a href="https://tika.apache.org/">Apache Tika</a>.</div>
</th>
</tr>
-<tr id="i291" class="rowColor">
+<tr id="i288" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/MissingDependencyException.html" title="class in org.apache.nutch.plugin">MissingDependencyException</a></td>
<th class="colLast" scope="row">
<div class="block"><code>MissingDependencyException</code> will be thrown if a plugin dependency
cannot be found.</div>
</th>
</tr>
-<tr id="i292" class="altColor">
+<tr id="i289" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/cosine/Model.html" title="class in org.apache.nutch.scoring.similarity.cosine">Model</a></td>
<th class="colLast" scope="row">
<div class="block">This class creates a model used to store Document vector representation of the corpus.</div>
</th>
</tr>
-<tr id="i293" class="rowColor">
+<tr id="i290" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/more/MoreIndexingFilter.html" title="class in org.apache.nutch.indexer.more">MoreIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Add (or reset) a few metaData properties as respective fields (if they are
available), so that they can be accurately used within the search index.</div>
</th>
</tr>
-<tr id="i294" class="altColor">
+<tr id="i291" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parsefilter/naivebayes/NaiveBayesParseFilter.html" title="class in org.apache.nutch.parsefilter.naivebayes">NaiveBayesParseFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Html Parse filter that classifies the outlinks from the parseresult as
@@ -1739,70 +1720,70 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
given in parsefilter.naivebayes.wordlist.</div>
</th>
</tr>
-<tr id="i295" class="rowColor">
+<tr id="i292" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/Node.html" title="class in org.apache.nutch.scoring.webgraph">Node</a></td>
<th class="colLast" scope="row">
<div class="block">A class which holds the number of inlinks and outlinks for a given url along
with an inlink score from a link analysis program and any metadata.</div>
</th>
</tr>
-<tr id="i296" class="altColor">
+<tr id="i293" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper</a></td>
<th class="colLast" scope="row">
<div class="block">A tools that dumps out the top urls by number of inlinks, number of outlinks,
or by score, to a text file.</div>
</th>
</tr>
-<tr id="i297" class="rowColor">
+<tr id="i294" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.Dumper.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper.Dumper</a></td>
<th class="colLast" scope="row">
<div class="block">Outputs the hosts or domains with an associated value.</div>
</th>
</tr>
-<tr id="i298" class="altColor">
+<tr id="i295" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.Dumper.DumperMapper.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper.Dumper.DumperMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Outputs the host or domain as key for this record and numInlinks,
numOutlinks or score as the value.</div>
</th>
</tr>
-<tr id="i299" class="rowColor">
+<tr id="i296" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.Dumper.DumperReducer.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper.Dumper.DumperReducer</a></td>
<th class="colLast" scope="row">
<div class="block">Outputs either the sum or the top value for this record.</div>
</th>
</tr>
-<tr id="i300" class="altColor">
+<tr id="i297" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.Sorter.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper.Sorter</a></td>
<th class="colLast" scope="row">
<div class="block">Outputs the top urls sorted in descending order.</div>
</th>
</tr>
-<tr id="i301" class="rowColor">
+<tr id="i298" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.Sorter.SorterMapper.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper.Sorter.SorterMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Outputs the url with the appropriate number of inlinks, outlinks, or for
score.</div>
</th>
</tr>
-<tr id="i302" class="altColor">
+<tr id="i299" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeDumper.Sorter.SorterReducer.html" title="class in org.apache.nutch.scoring.webgraph">NodeDumper.Sorter.SorterReducer</a></td>
<th class="colLast" scope="row">
<div class="block">Flips and collects the url and numeric sort value.</div>
</th>
</tr>
-<tr id="i303" class="rowColor">
+<tr id="i300" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/NodeReader.html" title="class in org.apache.nutch.scoring.webgraph">NodeReader</a></td>
<th class="colLast" scope="row">
<div class="block">Reads and prints to system out information for a single node from the NodeDb
in the WebGraph.</div>
</th>
</tr>
-<tr id="i304" class="altColor">
+<tr id="i301" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/NodeReader.html" title="class in org.apache.nutch.service.impl">NodeReader</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i305" class="rowColor">
+<tr id="i302" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/NodeWalker.html" title="class in org.apache.nutch.util">NodeWalker</a></td>
<th class="colLast" scope="row">
<div class="block">
@@ -1810,111 +1791,111 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
of recursion.</div>
</th>
</tr>
-<tr id="i306" class="altColor">
+<tr id="i303" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/Nutch.html" title="interface in org.apache.nutch.metadata">Nutch</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of Nutch internal metadata constants.</div>
</th>
</tr>
-<tr id="i307" class="rowColor">
+<tr id="i304" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/request/NutchConfig.html" title="class in org.apache.nutch.service.model.request">NutchConfig</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i308" class="altColor">
+<tr id="i305" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/NutchConfiguration.html" title="class in org.apache.nutch.util">NutchConfiguration</a></td>
<th class="colLast" scope="row">
<div class="block">Utility to create Hadoop <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/conf/Configuration.html?is-external=true" title="class or interface in org.apache.hadoop.conf" class="externalLink"><code>Configuration</code></a>s that include Nutch-specific
resources.</div>
</th>
</tr>
-<tr id="i309" class="rowColor">
+<tr id="i306" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/NutchDocument.html" title="class in org.apache.nutch.indexer">NutchDocument</a></td>
<th class="colLast" scope="row">
<div class="block">A <a href="org/apache/nutch/indexer/NutchDocument.html" title="class in org.apache.nutch.indexer"><code>NutchDocument</code></a> is the unit of indexing.</div>
</th>
</tr>
-<tr id="i310" class="altColor">
+<tr id="i307" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/NutchField.html" title="class in org.apache.nutch.indexer">NutchField</a></td>
<th class="colLast" scope="row">
<div class="block">This class represents a multi-valued field with a weight.</div>
</th>
</tr>
-<tr id="i311" class="rowColor">
+<tr id="i308" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/NutchIndexAction.html" title="class in org.apache.nutch.indexer">NutchIndexAction</a></td>
<th class="colLast" scope="row">
<div class="block">A <a href="org/apache/nutch/indexer/NutchIndexAction.html" title="class in org.apache.nutch.indexer"><code>NutchIndexAction</code></a> is the new unit of indexing holding the document
and action information.</div>
</th>
</tr>
-<tr id="i312" class="altColor">
+<tr id="i309" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/NutchJob.html" title="class in org.apache.nutch.util">NutchJob</a></td>
<th class="colLast" scope="row">
<div class="block">A <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/mapreduce/Job.html?is-external=true" title="class or interface in org.apache.hadoop.mapreduce" class="externalLink"><code>Job</code></a> for Nutch jobs.</div>
</th>
</tr>
-<tr id="i313" class="rowColor">
+<tr id="i310" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/publisher/NutchPublisher.html" title="interface in org.apache.nutch.publisher">NutchPublisher</a></td>
<th class="colLast" scope="row">
<div class="block">All publisher subscriber model implementations should implement this interface.</div>
</th>
</tr>
-<tr id="i314" class="altColor">
+<tr id="i311" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/publisher/NutchPublishers.html" title="class in org.apache.nutch.publisher">NutchPublishers</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i315" class="rowColor">
+<tr id="i312" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/NutchReader.html" title="interface in org.apache.nutch.service">NutchReader</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i316" class="altColor">
+<tr id="i313" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/NutchServer.html" title="class in org.apache.nutch.service">NutchServer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i317" class="rowColor">
+<tr id="i314" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/response/NutchServerInfo.html" title="class in org.apache.nutch.service.model.response">NutchServerInfo</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i318" class="altColor">
+<tr id="i315" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/NutchServerPoolExecutor.html" title="class in org.apache.nutch.service.impl">NutchServerPoolExecutor</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i319" class="rowColor">
+<tr id="i316" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/NutchTool.html" title="class in org.apache.nutch.util">NutchTool</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i320" class="altColor">
+<tr id="i317" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/NutchWritable.html" title="class in org.apache.nutch.crawl">NutchWritable</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i321" class="rowColor">
+<tr id="i318" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/ObjectCache.html" title="class in org.apache.nutch.util">ObjectCache</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i322" class="altColor">
+<tr id="i319" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/okhttp/OkHttp.html" title="class in org.apache.nutch.protocol.okhttp">OkHttp</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i323" class="rowColor">
+<tr id="i320" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/okhttp/OkHttpResponse.html" title="class in org.apache.nutch.protocol.okhttp">OkHttpResponse</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i324" class="altColor">
+<tr id="i321" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/okhttp/OkHttpResponse.TruncatedContent.html" title="class in org.apache.nutch.protocol.okhttp">OkHttpResponse.TruncatedContent</a></td>
<th class="colLast" scope="row">
<div class="block">Container to store whether and why content has been truncated</div>
</th>
</tr>
-<tr id="i325" class="rowColor">
+<tr id="i322" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/opensearch1x/OpenSearch1xConstants.html" title="interface in org.apache.nutch.indexwriter.opensearch1x">OpenSearch1xConstants</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i326" class="altColor">
+<tr id="i323" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/opensearch1x/OpenSearch1xIndexWriter.html" title="class in org.apache.nutch.indexwriter.opensearch1x">OpenSearch1xIndexWriter</a></td>
<th class="colLast" scope="row">
<div class="block">Sends NutchDocuments to a configured OpenSearch index.</div>
</th>
</tr>
-<tr id="i327" class="rowColor">
+<tr id="i324" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/opic/OPICScoringFilter.html" title="class in org.apache.nutch.scoring.opic">OPICScoringFilter</a></td>
<th class="colLast" scope="row">
<div class="block">This plugin implements a variant of an Online Page Importance Computation
@@ -1923,102 +1904,102 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
On-Line Page Importance Computation.</div>
</th>
</tr>
-<tr id="i328" class="altColor">
+<tr id="i325" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/orphan/OrphanScoringFilter.html" title="class in org.apache.nutch.scoring.orphan">OrphanScoringFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Orphan scoring filter that determines whether a page has become orphaned,
e.g.</div>
</th>
</tr>
-<tr id="i329" class="rowColor">
+<tr id="i326" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/Outlink.html" title="class in org.apache.nutch.parse">Outlink</a></td>
<th class="colLast" scope="row">
<div class="block">An outgoing link from a page.</div>
</th>
</tr>
-<tr id="i330" class="altColor">
+<tr id="i327" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/OutlinkExtractor.html" title="class in org.apache.nutch.parse">OutlinkExtractor</a></td>
<th class="colLast" scope="row">
<div class="block">Extractor to extract <a href="org/apache/nutch/parse/Outlink.html" title="class in org.apache.nutch.parse"><code>Outlink</code></a>s / URLs from
plain text using Regular Expressions.</div>
</th>
</tr>
-<tr id="i331" class="rowColor">
+<tr id="i328" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/Parse.html" title="interface in org.apache.nutch.parse">Parse</a></td>
<th class="colLast" scope="row">
<div class="block">The result of parsing a page's raw content.</div>
</th>
</tr>
-<tr id="i332" class="altColor">
+<tr id="i329" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseData.html" title="class in org.apache.nutch.parse">ParseData</a></td>
<th class="colLast" scope="row">
<div class="block">Data extracted from a page's content.</div>
</th>
</tr>
-<tr id="i333" class="rowColor">
+<tr id="i330" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseException.html" title="class in org.apache.nutch.parse">ParseException</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i334" class="altColor">
+<tr id="i331" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseImpl.html" title="class in org.apache.nutch.parse">ParseImpl</a></td>
<th class="colLast" scope="row">
<div class="block">The result of parsing a page's raw content.</div>
</th>
</tr>
-<tr id="i335" class="rowColor">
+<tr id="i332" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseOutputFormat.html" title="class in org.apache.nutch.parse">ParseOutputFormat</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i336" class="altColor">
+<tr id="i333" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/Parser.html" title="interface in org.apache.nutch.parse">Parser</a></td>
<th class="colLast" scope="row">
<div class="block">A parser for content generated by a
<a href="org/apache/nutch/protocol/Protocol.html" title="interface in org.apache.nutch.protocol"><code>Protocol</code></a> implementation.</div>
</th>
</tr>
-<tr id="i337" class="rowColor">
+<tr id="i334" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParserChecker.html" title="class in org.apache.nutch.parse">ParserChecker</a></td>
<th class="colLast" scope="row">
<div class="block">Parser checker, useful for testing parser.</div>
</th>
</tr>
-<tr id="i338" class="altColor">
+<tr id="i335" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseResult.html" title="class in org.apache.nutch.parse">ParseResult</a></td>
<th class="colLast" scope="row">
<div class="block">A utility class that stores result of a parse.</div>
</th>
</tr>
-<tr id="i339" class="rowColor">
+<tr id="i336" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParserFactory.html" title="class in org.apache.nutch.parse">ParserFactory</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/parse/Parser.html" title="interface in org.apache.nutch.parse"><code>Parser</code></a> plugins.</div>
</th>
</tr>
-<tr id="i340" class="altColor">
+<tr id="i337" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParserNotFound.html" title="class in org.apache.nutch.parse">ParserNotFound</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i341" class="rowColor">
+<tr id="i338" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseSegment.html" title="class in org.apache.nutch.parse">ParseSegment</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i342" class="altColor">
+<tr id="i339" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseSegment.ParseSegmentMapper.html" title="class in org.apache.nutch.parse">ParseSegment.ParseSegmentMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i343" class="rowColor">
+<tr id="i340" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseSegment.ParseSegmentReducer.html" title="class in org.apache.nutch.parse">ParseSegment.ParseSegmentReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i344" class="altColor">
+<tr id="i341" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseStatus.html" title="class in org.apache.nutch.parse">ParseStatus</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i345" class="rowColor">
+<tr id="i342" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseText.html" title="class in org.apache.nutch.parse">ParseText</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i346" class="altColor">
+<tr id="i343" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/ParseUtil.html" title="class in org.apache.nutch.parse">ParseUtil</a></td>
<th class="colLast" scope="row">
<div class="block">A Utility class containing methods to simply perform parsing utilities such
@@ -2026,19 +2007,19 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<a href="org/apache/nutch/parse/Parse.html" title="interface in org.apache.nutch.parse"><code>Parse</code></a> objects.</div>
</th>
</tr>
-<tr id="i347" class="rowColor">
+<tr id="i344" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/urlnormalizer/pass/PassURLNormalizer.html" title="class in org.apache.nutch.net.urlnormalizer.pass">PassURLNormalizer</a></td>
<th class="colLast" scope="row">
<div class="block">This URLNormalizer doesn't change urls.</div>
</th>
</tr>
-<tr id="i348" class="altColor">
+<tr id="i345" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/Pluggable.html" title="interface in org.apache.nutch.plugin">Pluggable</a></td>
<th class="colLast" scope="row">
<div class="block">Defines the capability of a class to be plugged into Nutch.</div>
</th>
</tr>
-<tr id="i349" class="rowColor">
+<tr id="i346" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/Plugin.html" title="class in org.apache.nutch.plugin">Plugin</a></td>
<th class="colLast" scope="row">
<div class="block">A nutch-plugin is an container for a set of custom logic that provide
@@ -2046,7 +2027,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
API for extending.</div>
</th>
</tr>
-<tr id="i350" class="altColor">
+<tr id="i347" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/PluginClassLoader.html" title="class in org.apache.nutch.plugin">PluginClassLoader</a></td>
<th class="colLast" scope="row">
<div class="block">The <code>PluginClassLoader</code> is a child-first classloader that only
@@ -2054,7 +2035,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
and exported libraries of plugins that are required plugins.</div>
</th>
</tr>
-<tr id="i351" class="rowColor">
+<tr id="i348" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/PluginDescriptor.html" title="class in org.apache.nutch.plugin">PluginDescriptor</a></td>
<th class="colLast" scope="row">
<div class="block">The <code>PluginDescriptor</code> provide access to all meta information of a
@@ -2062,7 +2043,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
classloader.</div>
</th>
</tr>
-<tr id="i352" class="altColor">
+<tr id="i349" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/PluginManifestParser.html" title="class in org.apache.nutch.plugin">PluginManifestParser</a></td>
<th class="colLast" scope="row">
<div class="block">The <code>PluginManifestParser</code> provides a mechanism for
@@ -2070,283 +2051,283 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
in a <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink"><code>String</code></a> of plugin directories.</div>
</th>
</tr>
-<tr id="i353" class="rowColor">
+<tr id="i350" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/PluginRepository.html" title="class in org.apache.nutch.plugin">PluginRepository</a></td>
<th class="colLast" scope="row">
<div class="block">The plugin repository is a registry of all plugins.</div>
</th>
</tr>
-<tr id="i354" class="altColor">
+<tr id="i351" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/PluginRuntimeException.html" title="class in org.apache.nutch.plugin">PluginRuntimeException</a></td>
<th class="colLast" scope="row">
<div class="block"><code>PluginRuntimeException</code> will be thrown until a exception in the
plugin managemnt occurs.</div>
</th>
</tr>
-<tr id="i355" class="rowColor">
+<tr id="i352" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/PrefixStringMatcher.html" title="class in org.apache.nutch.util">PrefixStringMatcher</a></td>
<th class="colLast" scope="row">
<div class="block">A class for efficiently matching <code>String</code>s against a set of
prefixes.</div>
</th>
</tr>
-<tr id="i356" class="altColor">
+<tr id="i353" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/prefix/PrefixURLFilter.html" title="class in org.apache.nutch.urlfilter.prefix">PrefixURLFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Filters URLs based on a file of URL prefixes.</div>
</th>
</tr>
-<tr id="i357" class="rowColor">
+<tr id="i354" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ftp/PrintCommandListener.html" title="class in org.apache.nutch.protocol.ftp">PrintCommandListener</a></td>
<th class="colLast" scope="row">
<div class="block">This is a support class for logging all ftp command/reply traffic.</div>
</th>
</tr>
-<tr id="i358" class="altColor">
+<tr id="i355" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/Protocol.html" title="interface in org.apache.nutch.protocol">Protocol</a></td>
<th class="colLast" scope="row">
<div class="block">A retriever of url content.</div>
</th>
</tr>
-<tr id="i359" class="rowColor">
+<tr id="i356" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/protocols/ProtocolException.html" title="class in org.apache.nutch.net.protocols">ProtocolException</a></td>
<th class="colLast" scope="row">Deprecated.
<div class="deprecationComment">Use <a href="org/apache/nutch/protocol/ProtocolException.html" title="class in org.apache.nutch.protocol"><code>ProtocolException</code></a> instead.</div>
</th>
</tr>
-<tr id="i360" class="altColor">
+<tr id="i357" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ProtocolException.html" title="class in org.apache.nutch.protocol">ProtocolException</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i361" class="rowColor">
+<tr id="i358" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ProtocolFactory.html" title="class in org.apache.nutch.protocol">ProtocolFactory</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/protocol/Protocol.html" title="interface in org.apache.nutch.protocol"><code>Protocol</code></a> plugins.</div>
</th>
</tr>
-<tr id="i362" class="altColor">
+<tr id="i359" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/protocols/ProtocolLogUtil.html" title="class in org.apache.nutch.net.protocols">ProtocolLogUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i363" class="rowColor">
+<tr id="i360" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ProtocolNotFound.html" title="class in org.apache.nutch.protocol">ProtocolNotFound</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i364" class="altColor">
+<tr id="i361" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ProtocolOutput.html" title="class in org.apache.nutch.protocol">ProtocolOutput</a></td>
<th class="colLast" scope="row">
<div class="block">Simple aggregate to pass from protocol plugins both content and protocol
status.</div>
</th>
</tr>
-<tr id="i365" class="rowColor">
+<tr id="i362" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/ProtocolStatus.html" title="class in org.apache.nutch.protocol">ProtocolStatus</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i366" class="altColor">
+<tr id="i363" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/ProtocolStatusStatistics.html" title="class in org.apache.nutch.util">ProtocolStatusStatistics</a></td>
<th class="colLast" scope="row">
<div class="block">Extracts protocol status code information from the crawl database.</div>
</th>
</tr>
-<tr id="i367" class="rowColor">
+<tr id="i364" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/ProtocolStatusStatistics.ProtocolStatusStatisticsCombiner.html" title="class in org.apache.nutch.util">ProtocolStatusStatistics.ProtocolStatusStatisticsCombiner</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i368" class="altColor">
+<tr id="i365" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/urlnormalizer/protocol/ProtocolURLNormalizer.html" title="class in org.apache.nutch.net.urlnormalizer.protocol">ProtocolURLNormalizer</a></td>
<th class="colLast" scope="row">
<div class="block">URL normalizer to normalize the protocol for all URLs of a given host or
domain, e.g.</div>
</th>
</tr>
-<tr id="i369" class="rowColor">
+<tr id="i366" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/urlnormalizer/querystring/QuerystringURLNormalizer.html" title="class in org.apache.nutch.net.urlnormalizer.querystring">QuerystringURLNormalizer</a></td>
<th class="colLast" scope="row">
<div class="block">URL normalizer plugin for normalizing query strings but sorting query string
parameters.</div>
</th>
</tr>
-<tr id="i370" class="altColor">
+<tr id="i367" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/fetcher/QueueFeeder.html" title="class in org.apache.nutch.fetcher">QueueFeeder</a></td>
<th class="colLast" scope="row">
<div class="block">This class feeds the queues with input items, and re-fills them as items
are consumed by FetcherThread-s.</div>
</th>
</tr>
-<tr id="i371" class="rowColor">
+<tr id="i368" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/rabbit/RabbitIndexWriter.html" title="class in org.apache.nutch.indexwriter.rabbit">RabbitIndexWriter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i372" class="altColor">
+<tr id="i369" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/rabbitmq/RabbitMQClient.html" title="class in org.apache.nutch.rabbitmq">RabbitMQClient</a></td>
<th class="colLast" scope="row">
<div class="block">Client for RabbitMQ</div>
</th>
</tr>
-<tr id="i373" class="rowColor">
+<tr id="i370" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/rabbitmq/RabbitMQMessage.html" title="class in org.apache.nutch.rabbitmq">RabbitMQMessage</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i374" class="altColor">
+<tr id="i371" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/publisher/rabbitmq/RabbitMQPublisherImpl.html" title="class in org.apache.nutch.publisher.rabbitmq">RabbitMQPublisherImpl</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i375" class="rowColor">
+<tr id="i372" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/request/ReaderConfig.html" title="class in org.apache.nutch.service.model.request">ReaderConfig</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i376" class="altColor">
+<tr id="i373" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/resources/ReaderResouce.html" title="class in org.apache.nutch.service.resources">ReaderResouce</a></td>
<th class="colLast" scope="row">
<div class="block">The Reader endpoint enables a user to read sequence files,
nodes and links from the Nutch webgraph.</div>
</th>
</tr>
-<tr id="i377" class="rowColor">
+<tr id="i374" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/ReadHostDb.html" title="class in org.apache.nutch.hostdb">ReadHostDb</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i378" class="altColor">
+<tr id="i375" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parsefilter/regex/RegexParseFilter.html" title="class in org.apache.nutch.parsefilter.regex">RegexParseFilter</a></td>
<th class="colLast" scope="row">
<div class="block">RegexParseFilter.</div>
</th>
</tr>
-<tr id="i379" class="rowColor">
+<tr id="i376" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/api/RegexRule.html" title="class in org.apache.nutch.urlfilter.api">RegexRule</a></td>
<th class="colLast" scope="row">
<div class="block">A generic regular expression rule.</div>
</th>
</tr>
-<tr id="i380" class="altColor">
+<tr id="i377" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/regex/RegexURLFilter.html" title="class in org.apache.nutch.urlfilter.regex">RegexURLFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Filters URLs based on a file of regular expressions using the
<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/regex/package-summary.html?is-external=true" class="externalLink"><code>Java Regex implementation</code></a>.</div>
</th>
</tr>
-<tr id="i381" class="rowColor">
+<tr id="i378" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/api/RegexURLFilterBase.html" title="class in org.apache.nutch.urlfilter.api">RegexURLFilterBase</a></td>
<th class="colLast" scope="row">
<div class="block">Generic <a href="org/apache/nutch/net/URLFilter.html" title="interface in org.apache.nutch.net"><code>URLFilter</code></a> based on regular
expressions.</div>
</th>
</tr>
-<tr id="i382" class="altColor">
+<tr id="i379" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/urlnormalizer/regex/RegexURLNormalizer.html" title="class in org.apache.nutch.net.urlnormalizer.regex">RegexURLNormalizer</a></td>
<th class="colLast" scope="row">
<div class="block">Allows users to do regex substitutions on all/any URLs that are encountered,
which is useful for stripping session IDs from URLs.</div>
</th>
</tr>
-<tr id="i383" class="rowColor">
+<tr id="i380" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/microformats/reltag/RelTagIndexingFilter.html" title="class in org.apache.nutch.microformats.reltag">RelTagIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">An <a href="org/apache/nutch/indexer/IndexingFilter.html" title="interface in org.apache.nutch.indexer"><code>IndexingFilter</code></a> that add <code>tag</code>
field(s) to the document.</div>
</th>
</tr>
-<tr id="i384" class="altColor">
+<tr id="i381" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/microformats/reltag/RelTagParser.html" title="class in org.apache.nutch.microformats.reltag">RelTagParser</a></td>
<th class="colLast" scope="row">
<div class="block">Adds microformat rel-tags of document if found.</div>
</th>
</tr>
-<tr id="i385" class="rowColor">
+<tr id="i382" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/replace/ReplaceIndexer.html" title="class in org.apache.nutch.indexer.replace">ReplaceIndexer</a></td>
<th class="colLast" scope="row">
<div class="block">Do pattern replacements on selected field contents prior to indexing.</div>
</th>
</tr>
-<tr id="i386" class="altColor">
+<tr id="i383" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/ResolverThread.html" title="class in org.apache.nutch.hostdb">ResolverThread</a></td>
<th class="colLast" scope="row">
<div class="block">Simple runnable that performs DNS lookup for a single host.</div>
</th>
</tr>
-<tr id="i387" class="rowColor">
+<tr id="i384" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/tools/ResolveUrls.html" title="class in org.apache.nutch.tools">ResolveUrls</a></td>
<th class="colLast" scope="row">
<div class="block">A simple tool that will spin up multiple threads to resolve urls to ip
addresses.</div>
</th>
</tr>
-<tr id="i388" class="altColor">
+<tr id="i385" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/protocols/Response.html" title="interface in org.apache.nutch.net.protocols">Response</a></td>
<th class="colLast" scope="row">
<div class="block">A response interface.</div>
</th>
</tr>
-<tr id="i389" class="rowColor">
+<tr id="i386" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/protocols/Response.TruncatedContentReason.html" title="enum in org.apache.nutch.net.protocols">Response.TruncatedContentReason</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i390" class="altColor">
+<tr id="i387" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/protocol/RobotRulesParser.html" title="class in org.apache.nutch.protocol">RobotRulesParser</a></td>
<th class="colLast" scope="row">
<div class="block">This class uses crawler-commons for handling the parsing of
<code>robots.txt</code> files.</div>
</th>
</tr>
-<tr id="i391" class="rowColor">
+<tr id="i388" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/ScoreUpdater.html" title="class in org.apache.nutch.scoring.webgraph">ScoreUpdater</a></td>
<th class="colLast" scope="row">
<div class="block">Updates the score from the WebGraph node database into the crawl database.</div>
</th>
</tr>
-<tr id="i392" class="altColor">
+<tr id="i389" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/ScoreUpdater.ScoreUpdaterMapper.html" title="class in org.apache.nutch.scoring.webgraph">ScoreUpdater.ScoreUpdaterMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Changes input into ObjectWritables.</div>
</th>
</tr>
-<tr id="i393" class="rowColor">
+<tr id="i390" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/ScoreUpdater.ScoreUpdaterReducer.html" title="class in org.apache.nutch.scoring.webgraph">ScoreUpdater.ScoreUpdaterReducer</a></td>
<th class="colLast" scope="row">
<div class="block">Creates new CrawlDatum objects with the updated score from the NodeDb or
with a cleared score.</div>
</th>
</tr>
-<tr id="i394" class="altColor">
+<tr id="i391" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/ScoringFilter.html" title="interface in org.apache.nutch.scoring">ScoringFilter</a></td>
<th class="colLast" scope="row">
<div class="block">A contract defining behavior of scoring plugins.</div>
</th>
</tr>
-<tr id="i395" class="rowColor">
+<tr id="i392" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/ScoringFilterException.html" title="class in org.apache.nutch.scoring">ScoringFilterException</a></td>
<th class="colLast" scope="row">
<div class="block">Specialized exception for errors during scoring.</div>
</th>
</tr>
-<tr id="i396" class="altColor">
+<tr id="i393" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/ScoringFilters.html" title="class in org.apache.nutch.scoring">ScoringFilters</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/scoring/ScoringFilter.html" title="interface in org.apache.nutch.scoring"><code>ScoringFilter</code></a> implementing plugins.</div>
</th>
</tr>
-<tr id="i397" class="rowColor">
+<tr id="i394" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/request/SeedList.html" title="class in org.apache.nutch.service.model.request">SeedList</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i398" class="altColor">
+<tr id="i395" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/SeedManager.html" title="interface in org.apache.nutch.service">SeedManager</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i399" class="rowColor">
+<tr id="i396" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/SeedManagerImpl.html" title="class in org.apache.nutch.service.impl">SeedManagerImpl</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i400" class="altColor">
+<tr id="i397" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/resources/SeedResource.html" title="class in org.apache.nutch.service.resources">SeedResource</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i401" class="rowColor">
+<tr id="i398" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/request/SeedUrl.html" title="class in org.apache.nutch.service.model.request">SeedUrl</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i402" class="altColor">
+<tr id="i399" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentChecker.html" title="class in org.apache.nutch.segment">SegmentChecker</a></td>
<th class="colLast" scope="row">
<div class="block">Checks whether a segment is valid, or has a certain status (generated,
@@ -2354,138 +2335,138 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
(e.g., indexing).</div>
</th>
</tr>
-<tr id="i403" class="rowColor">
+<tr id="i400" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMergeFilter.html" title="interface in org.apache.nutch.segment">SegmentMergeFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Interface used to filter segments during segment merge.</div>
</th>
</tr>
-<tr id="i404" class="altColor">
+<tr id="i401" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMergeFilters.html" title="class in org.apache.nutch.segment">SegmentMergeFilters</a></td>
<th class="colLast" scope="row">
<div class="block">This class wraps all <a href="org/apache/nutch/segment/SegmentMergeFilter.html" title="interface in org.apache.nutch.segment"><code>SegmentMergeFilter</code></a> extensions in a single object
so it is easier to operate on them.</div>
</th>
</tr>
-<tr id="i405" class="rowColor">
+<tr id="i402" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMerger.html" title="class in org.apache.nutch.segment">SegmentMerger</a></td>
<th class="colLast" scope="row">
<div class="block">This tool takes several segments and merges their data together.</div>
</th>
</tr>
-<tr id="i406" class="altColor">
+<tr id="i403" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMerger.ObjectInputFormat.html" title="class in org.apache.nutch.segment">SegmentMerger.ObjectInputFormat</a></td>
<th class="colLast" scope="row">
<div class="block">Wraps inputs in an <a href="org/apache/nutch/metadata/MetaWrapper.html" title="class in org.apache.nutch.metadata"><code>MetaWrapper</code></a>, to permit merging different types
in reduce and use additional metadata.</div>
</th>
</tr>
-<tr id="i407" class="rowColor">
+<tr id="i404" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMerger.SegmentMergerMapper.html" title="class in org.apache.nutch.segment">SegmentMerger.SegmentMergerMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i408" class="altColor">
+<tr id="i405" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMerger.SegmentMergerReducer.html" title="class in org.apache.nutch.segment">SegmentMerger.SegmentMergerReducer</a></td>
<th class="colLast" scope="row">
<div class="block">NOTE: in selecting the latest version we rely exclusively on the segment
name (not all segment data contain time information).</div>
</th>
</tr>
-<tr id="i409" class="rowColor">
+<tr id="i406" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentMerger.SegmentOutputFormat.html" title="class in org.apache.nutch.segment">SegmentMerger.SegmentOutputFormat</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i410" class="altColor">
+<tr id="i407" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentPart.html" title="class in org.apache.nutch.segment">SegmentPart</a></td>
<th class="colLast" scope="row">
<div class="block">Utility class for handling information about segment parts.</div>
</th>
</tr>
-<tr id="i411" class="rowColor">
+<tr id="i408" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentReader.html" title="class in org.apache.nutch.segment">SegmentReader</a></td>
<th class="colLast" scope="row">
<div class="block">Dump the content of a segment.</div>
</th>
</tr>
-<tr id="i412" class="altColor">
+<tr id="i409" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentReader.InputCompatMapper.html" title="class in org.apache.nutch.segment">SegmentReader.InputCompatMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i413" class="rowColor">
+<tr id="i410" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentReader.InputCompatReducer.html" title="class in org.apache.nutch.segment">SegmentReader.InputCompatReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i414" class="altColor">
+<tr id="i411" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentReader.SegmentReaderStats.html" title="class in org.apache.nutch.segment">SegmentReader.SegmentReaderStats</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i415" class="rowColor">
+<tr id="i412" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/segment/SegmentReader.TextOutputFormat.html" title="class in org.apache.nutch.segment">SegmentReader.TextOutputFormat</a></td>
<th class="colLast" scope="row">
<div class="block">Implements a text output format</div>
</th>
</tr>
-<tr id="i416" class="altColor">
+<tr id="i413" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/SegmentReaderUtil.html" title="class in org.apache.nutch.util">SegmentReaderUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i417" class="rowColor">
+<tr id="i414" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/SequenceReader.html" title="class in org.apache.nutch.service.impl">SequenceReader</a></td>
<th class="colLast" scope="row">
<div class="block">Enables reading a sequence file and methods provide different
ways to read the file.</div>
</th>
</tr>
-<tr id="i418" class="altColor">
+<tr id="i415" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/request/ServiceConfig.html" title="class in org.apache.nutch.service.model.request">ServiceConfig</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i419" class="rowColor">
+<tr id="i416" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/model/response/ServiceInfo.html" title="class in org.apache.nutch.service.model.response">ServiceInfo</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i420" class="altColor">
+<tr id="i417" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/service/resources/ServicesResource.html" title="class in org.apache.nutch.service.resources">ServicesResource</a></td>
<th class="colLast" scope="row">
<div class="block">The services resource defines an endpoint to enable the user to carry out
Nutch jobs like dump, commoncrawldump, etc.</div>
</th>
</tr>
-<tr id="i421" class="rowColor">
+<tr id="i418" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/service/impl/ServiceWorker.html" title="class in org.apache.nutch.service.impl">ServiceWorker</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i422" class="altColor">
+<tr id="i419" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/ShowProperties.html" title="class in org.apache.nutch.tools">ShowProperties</a></td>
<th class="colLast" scope="row">
<div class="block">Tool to list properties and their values set by the current Nutch
configuration</div>
</th>
</tr>
-<tr id="i423" class="rowColor">
+<tr id="i420" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/Signature.html" title="class in org.apache.nutch.crawl">Signature</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i424" class="altColor">
+<tr id="i421" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/SignatureComparator.html" title="class in org.apache.nutch.crawl">SignatureComparator</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i425" class="rowColor">
+<tr id="i422" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/SignatureFactory.html" title="class in org.apache.nutch.crawl">SignatureFactory</a></td>
<th class="colLast" scope="row">
<div class="block">Factory class, which instantiates a Signature implementation according to the
current Configuration configuration.</div>
</th>
</tr>
-<tr id="i426" class="altColor">
+<tr id="i423" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/SimilarityModel.html" title="interface in org.apache.nutch.scoring.similarity">SimilarityModel</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i427" class="rowColor">
+<tr id="i424" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/similarity/SimilarityScoringFilter.html" title="class in org.apache.nutch.scoring.similarity">SimilarityScoringFilter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i428" class="altColor">
+<tr id="i425" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/SitemapProcessor.html" title="class in org.apache.nutch.util">SitemapProcessor</a></td>
<th class="colLast" scope="row">
<div class="block">
@@ -2494,183 +2475,165 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
the metadata) into the CrawlDb.</div>
</th>
</tr>
-<tr id="i429" class="rowColor">
+<tr id="i426" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/urlnormalizer/slash/SlashURLNormalizer.html" title="class in org.apache.nutch.net.urlnormalizer.slash">SlashURLNormalizer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i430" class="altColor">
+<tr id="i427" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/solr/SolrConstants.html" title="interface in org.apache.nutch.indexwriter.solr">SolrConstants</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i431" class="rowColor">
+<tr id="i428" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/solr/SolrIndexWriter.html" title="class in org.apache.nutch.indexwriter.solr">SolrIndexWriter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i432" class="altColor">
+<tr id="i429" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexwriter/solr/SolrUtils.html" title="class in org.apache.nutch.indexwriter.solr">SolrUtils</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i433" class="rowColor">
+<tr id="i430" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/metadata/SpellCheckedMetadata.html" title="class in org.apache.nutch.metadata">SpellCheckedMetadata</a></td>
<th class="colLast" scope="row">
<div class="block">A decorator to Metadata that adds spellchecking capabilities to property
names.</div>
</th>
</tr>
-<tr id="i434" class="altColor">
+<tr id="i431" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/staticfield/StaticFieldIndexer.html" title="class in org.apache.nutch.indexer.staticfield">StaticFieldIndexer</a></td>
<th class="colLast" scope="row">
<div class="block">A simple plugin called at indexing that adds fields with static data.</div>
</th>
</tr>
-<tr id="i435" class="rowColor">
+<tr id="i432" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/StringUtil.html" title="class in org.apache.nutch.util">StringUtil</a></td>
<th class="colLast" scope="row">
<div class="block">A collection of String processing utility methods.</div>
</th>
</tr>
-<tr id="i436" class="altColor">
+<tr id="i433" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/collection/Subcollection.html" title="class in org.apache.nutch.collection">Subcollection</a></td>
<th class="colLast" scope="row">
<div class="block">SubCollection represents a subset of index, you can define url patterns that
will indicate that particular page (url) is part of SubCollection.</div>
</th>
</tr>
-<tr id="i437" class="rowColor">
+<tr id="i434" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/subcollection/SubcollectionIndexingFilter.html" title="class in org.apache.nutch.indexer.subcollection">SubcollectionIndexingFilter</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i438" class="altColor">
+<tr id="i435" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/SuffixStringMatcher.html" title="class in org.apache.nutch.util">SuffixStringMatcher</a></td>
<th class="colLast" scope="row">
<div class="block">A class for efficiently matching <code>String</code>s against a set of
suffixes.</div>
</th>
</tr>
-<tr id="i439" class="rowColor">
+<tr id="i436" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/suffix/SuffixURLFilter.html" title="class in org.apache.nutch.urlfilter.suffix">SuffixURLFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Filters URLs based on a file of URL suffixes.</div>
</th>
</tr>
-<tr id="i440" class="altColor">
+<tr id="i437" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/TableUtil.html" title="class in org.apache.nutch.util">TableUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i441" class="rowColor">
+<tr id="i438" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/TextMD5Signature.html" title="class in org.apache.nutch.crawl">TextMD5Signature</a></td>
<th class="colLast" scope="row">
<div class="block">Implementation of a page signature.</div>
</th>
</tr>
-<tr id="i442" class="altColor">
+<tr id="i439" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/TextProfileSignature.html" title="class in org.apache.nutch.crawl">TextProfileSignature</a></td>
<th class="colLast" scope="row">
<div class="block">
An implementation of a page signature.</div>
</th>
</tr>
-<tr id="i443" class="rowColor">
+<tr id="i440" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/tika/TikaParser.html" title="class in org.apache.nutch.parse.tika">TikaParser</a></td>
<th class="colLast" scope="row">
<div class="block">Wrapper for Tika parsers.</div>
</th>
</tr>
-<tr id="i444" class="altColor">
+<tr id="i441" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/TimingUtil.html" title="class in org.apache.nutch.util">TimingUtil</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i445" class="rowColor">
+<tr id="i442" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/tld/TLDIndexingFilter.html" title="class in org.apache.nutch.indexer.tld">TLDIndexingFilter</a></td>
<th class="colLast" scope="row">
-<div class="block">Adds the top-level domain extensions to the index</div>
-</th>
-</tr>
-<tr id="i446" class="altColor">
-<td class="colFirst"><a href="org/apache/nutch/scoring/tld/TLDScoringFilter.html" title="class in org.apache.nutch.scoring.tld">TLDScoringFilter</a></td>
-<th class="colLast" scope="row">
-<div class="block">Scoring filter to boost top-level domains (TLDs).</div>
-</th>
-</tr>
-<tr id="i447" class="rowColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain">TopLevelDomain</a></td>
-<th class="colLast" scope="row">
-<div class="block">(From wikipedia) A top-level domain (TLD) is the last part of an Internet
- domain name; that is, the letters which follow the final dot of any domain
- name.</div>
+<div class="block">Adds the public suffix (aka.</div>
</th>
</tr>
-<tr id="i448" class="altColor">
-<td class="colFirst"><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></td>
-<th class="colLast" scope="row"> </th>
-</tr>
-<tr id="i449" class="rowColor">
+<tr id="i443" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parsefilter/naivebayes/Train.html" title="class in org.apache.nutch.parsefilter.naivebayes">Train</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i450" class="altColor">
+<tr id="i444" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/util/TrieStringMatcher.html" title="class in org.apache.nutch.util">TrieStringMatcher</a></td>
<th class="colLast" scope="row">
<div class="block">TrieStringMatcher is a base class for simple tree-based string matching.</div>
</th>
</tr>
-<tr id="i451" class="rowColor">
+<tr id="i445" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/UpdateHostDb.html" title="class in org.apache.nutch.hostdb">UpdateHostDb</a></td>
<th class="colLast" scope="row">
<div class="block">Tool to create a HostDB from the CrawlDB.</div>
</th>
</tr>
-<tr id="i452" class="altColor">
+<tr id="i446" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/UpdateHostDbMapper.html" title="class in org.apache.nutch.hostdb">UpdateHostDbMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Mapper ingesting HostDB and CrawlDB entries.</div>
</th>
</tr>
-<tr id="i453" class="rowColor">
+<tr id="i447" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html" title="class in org.apache.nutch.hostdb">UpdateHostDbReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i454" class="altColor">
+<tr id="i448" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLExemptionFilter.html" title="interface in org.apache.nutch.net">URLExemptionFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Interface used to allow exemptions to external domain resources by overriding <code>db.ignore.external.links</code>.</div>
</th>
</tr>
-<tr id="i455" class="rowColor">
+<tr id="i449" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLExemptionFilters.html" title="class in org.apache.nutch.net">URLExemptionFilters</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches <a href="org/apache/nutch/net/URLExemptionFilter.html" title="interface in org.apache.nutch.net"><code>URLExemptionFilter</code></a> implementing plugins.</div>
</th>
</tr>
-<tr id="i456" class="altColor">
+<tr id="i450" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLFilter.html" title="interface in org.apache.nutch.net">URLFilter</a></td>
<th class="colLast" scope="row">
<div class="block">Interface used to limit which URLs enter Nutch.</div>
</th>
</tr>
-<tr id="i457" class="rowColor">
+<tr id="i451" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLFilterChecker.html" title="class in org.apache.nutch.net">URLFilterChecker</a></td>
<th class="colLast" scope="row">
<div class="block">Checks one given filter or all filters.</div>
</th>
</tr>
-<tr id="i458" class="altColor">
+<tr id="i452" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLFilterException.html" title="class in org.apache.nutch.net">URLFilterException</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i459" class="rowColor">
+<tr id="i453" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLFilters.html" title="class in org.apache.nutch.net">URLFilters</a></td>
<th class="colLast" scope="row">
<div class="block">Creates and caches plugins implementing <a href="org/apache/nutch/net/URLFilter.html" title="interface in org.apache.nutch.net"><code>URLFilter</code></a>.</div>
</th>
</tr>
-<tr id="i460" class="altColor">
+<tr id="i454" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/indexer/urlmeta/URLMetaIndexingFilter.html" title="class in org.apache.nutch.indexer.urlmeta">URLMetaIndexingFilter</a></td>
<th class="colLast" scope="row">
<div class="block">This is part of the URL Meta plugin.</div>
</th>
</tr>
-<tr id="i461" class="rowColor">
+<tr id="i455" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/urlmeta/URLMetaScoringFilter.html" title="class in org.apache.nutch.scoring.urlmeta">URLMetaScoringFilter</a></td>
<th class="colLast" scope="row">
<div class="block">For documentation:
@@ -2678,33 +2641,33 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<a href="org/apache/nutch/scoring/urlmeta/package-summary.html"><code>org.apache.nutch.scoring.urlmeta</code></a></div>
</th>
</tr>
-<tr id="i462" class="altColor">
+<tr id="i456" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLNormalizer.html" title="interface in org.apache.nutch.net">URLNormalizer</a></td>
<th class="colLast" scope="row">
<div class="block">Interface used to convert URLs to normal form and optionally perform
substitutions</div>
</th>
</tr>
-<tr id="i463" class="rowColor">
+<tr id="i457" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLNormalizerChecker.html" title="class in org.apache.nutch.net">URLNormalizerChecker</a></td>
<th class="colLast" scope="row">
<div class="block">Checks one given normalizer or all normalizers.</div>
</th>
</tr>
-<tr id="i464" class="altColor">
+<tr id="i458" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/net/URLNormalizers.html" title="class in org.apache.nutch.net">URLNormalizers</a></td>
<th class="colLast" scope="row">
<div class="block">This class uses a "chained filter" pattern to run defined normalizers.</div>
</th>
</tr>
-<tr id="i465" class="rowColor">
+<tr id="i459" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/crawl/URLPartitioner.html" title="class in org.apache.nutch.crawl">URLPartitioner</a></td>
<th class="colLast" scope="row">
<div class="block">Partition urls by host, domain name or IP depending on the value of the
parameter 'partition.url.mode' which can be 'byHost', 'byDomain' or 'byIP'</div>
</th>
</tr>
-<tr id="i466" class="altColor">
+<tr id="i460" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/plugin/URLStreamHandlerFactory.html" title="class in org.apache.nutch.plugin">URLStreamHandlerFactory</a></td>
<th class="colLast" scope="row">
<div class="block">This URLStreamHandlerFactory knows about all the plugins
@@ -2712,42 +2675,42 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
even if it comes from a plugin classpath.</div>
</th>
</tr>
-<tr id="i467" class="rowColor">
+<tr id="i461" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></td>
<th class="colLast" scope="row">
<div class="block">Utility class for URL analysis</div>
</th>
</tr>
-<tr id="i468" class="altColor">
+<tr id="i462" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/urlfilter/validator/UrlValidator.html" title="class in org.apache.nutch.urlfilter.validator">UrlValidator</a></td>
<th class="colLast" scope="row">
<div class="block">
Validates URLs.</div>
</th>
</tr>
-<tr id="i469" class="rowColor">
+<tr id="i463" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/warc/WARCExporter.html" title="class in org.apache.nutch.tools.warc">WARCExporter</a></td>
<th class="colLast" scope="row">
<div class="block">MapReduce job to exports Nutch segments as WARC files.</div>
</th>
</tr>
-<tr id="i470" class="altColor">
+<tr id="i464" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/tools/warc/WARCExporter.WARCMapReduce.html" title="class in org.apache.nutch.tools.warc">WARCExporter.WARCMapReduce</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i471" class="rowColor">
+<tr id="i465" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/warc/WARCExporter.WARCMapReduce.WARCMapper.html" title="class in org.apache.nutch.tools.warc">WARCExporter.WARCMapReduce.WARCMapper</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i472" class="altColor">
+<tr id="i466" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/tools/warc/WARCExporter.WARCMapReduce.WARCReducer.html" title="class in org.apache.nutch.tools.warc">WARCExporter.WARCMapReduce.WARCReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i473" class="rowColor">
+<tr id="i467" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/tools/WARCUtils.html" title="class in org.apache.nutch.tools">WARCUtils</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i474" class="altColor">
+<tr id="i468" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/WebGraph.html" title="class in org.apache.nutch.scoring.webgraph">WebGraph</a></td>
<th class="colLast" scope="row">
<div class="block">Creates three databases, one for inlinks, one for outlinks, and a node
@@ -2755,37 +2718,37 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
score for the url.</div>
</th>
</tr>
-<tr id="i475" class="rowColor">
+<tr id="i469" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/WebGraph.OutlinkDb.html" title="class in org.apache.nutch.scoring.webgraph">WebGraph.OutlinkDb</a></td>
<th class="colLast" scope="row">
<div class="block">The OutlinkDb creates a database of all outlinks.</div>
</th>
</tr>
-<tr id="i476" class="altColor">
+<tr id="i470" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/WebGraph.OutlinkDb.OutlinkDbMapper.html" title="class in org.apache.nutch.scoring.webgraph">WebGraph.OutlinkDb.OutlinkDbMapper</a></td>
<th class="colLast" scope="row">
<div class="block">Passes through existing LinkDatum objects from an existing OutlinkDb and
maps out new LinkDatum objects from new crawls ParseData.</div>
</th>
</tr>
-<tr id="i477" class="rowColor">
+<tr id="i471" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/scoring/webgraph/WebGraph.OutlinkDb.OutlinkDbReducer.html" title="class in org.apache.nutch.scoring.webgraph">WebGraph.OutlinkDb.OutlinkDbReducer</a></td>
<th class="colLast" scope="row"> </th>
</tr>
-<tr id="i478" class="altColor">
+<tr id="i472" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/html/XMLCharacterRecognizer.html" title="class in org.apache.nutch.parse.html">XMLCharacterRecognizer</a></td>
<th class="colLast" scope="row">
<div class="block">Class used to verify whether the specified <var>ch</var> conforms to the XML
1.0 definition of whitespace.</div>
</th>
</tr>
-<tr id="i479" class="rowColor">
+<tr id="i473" class="rowColor">
<td class="colFirst"><a href="org/apache/nutch/parse/zip/ZipParser.html" title="class in org.apache.nutch.parse.zip">ZipParser</a></td>
<th class="colLast" scope="row">
<div class="block">ZipParser class based on MSPowerPointParser class by Stephan Strittmatter.</div>
</th>
</tr>
-<tr id="i480" class="altColor">
+<tr id="i474" class="altColor">
<td class="colFirst"><a href="org/apache/nutch/parse/zip/ZipTextExtractor.html" title="class in org.apache.nutch.parse.zip">ZipTextExtractor</a></td>
<th class="colLast" scope="row"> </th>
</tr>
@@ -2839,7 +2802,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/allclasses.html b/content/documentation/javadoc/api/allclasses.html
index 925a482..6395568 100644
--- a/content/documentation/javadoc/api/allclasses.html
+++ b/content/documentation/javadoc/api/allclasses.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>All Classes (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>All Classes (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,7 +15,7 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
@@ -112,12 +112,9 @@
<li><a href="org/apache/nutch/tools/DmozParser.html" title="class in org.apache.nutch.tools">DmozParser</a></li>
<li><a href="org/apache/nutch/scoring/similarity/cosine/DocVector.html" title="class in org.apache.nutch.scoring.similarity.cosine">DocVector</a></li>
<li><a href="org/apache/nutch/urlfilter/domaindenylist/DomainDenylistURLFilter.html" title="class in org.apache.nutch.urlfilter.domaindenylist">DomainDenylistURLFilter</a></li>
-<li><a href="org/apache/nutch/util/domain/DomainStatistics.html" title="class in org.apache.nutch.util.domain">DomainStatistics</a></li>
-<li><a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util.domain">DomainStatistics.DomainStatisticsCombiner</a></li>
-<li><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></li>
-<li><a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></li>
-<li><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></li>
-<li><a href="org/apache/nutch/util/domain/DomainSuffixes.html" title="class in org.apache.nutch.util.domain">DomainSuffixes</a></li>
+<li><a href="org/apache/nutch/util/DomainStatistics.html" title="class in org.apache.nutch.util">DomainStatistics</a></li>
+<li><a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util">DomainStatistics.DomainStatisticsCombiner</a></li>
+<li><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></li>
<li><a href="org/apache/nutch/urlfilter/domain/DomainURLFilter.html" title="class in org.apache.nutch.urlfilter.domain">DomainURLFilter</a></li>
<li><a href="org/apache/nutch/parse/html/DOMBuilder.html" title="class in org.apache.nutch.parse.html">DOMBuilder</a></li>
<li><a href="org/apache/nutch/parse/html/DOMContentUtils.html" title="class in org.apache.nutch.parse.html">DOMContentUtils</a></li>
@@ -469,9 +466,6 @@
<li><a href="org/apache/nutch/parse/tika/TikaParser.html" title="class in org.apache.nutch.parse.tika">TikaParser</a></li>
<li><a href="org/apache/nutch/util/TimingUtil.html" title="class in org.apache.nutch.util">TimingUtil</a></li>
<li><a href="org/apache/nutch/indexer/tld/TLDIndexingFilter.html" title="class in org.apache.nutch.indexer.tld">TLDIndexingFilter</a></li>
-<li><a href="org/apache/nutch/scoring/tld/TLDScoringFilter.html" title="class in org.apache.nutch.scoring.tld">TLDScoringFilter</a></li>
-<li><a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain">TopLevelDomain</a></li>
-<li><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></li>
<li><a href="org/apache/nutch/parsefilter/naivebayes/Train.html" title="class in org.apache.nutch.parsefilter.naivebayes">Train</a></li>
<li><a href="org/apache/nutch/util/TrieStringMatcher.html" title="class in org.apache.nutch.util">TrieStringMatcher</a></li>
<li><a href="org/apache/nutch/hostdb/UpdateHostDb.html" title="class in org.apache.nutch.hostdb">UpdateHostDb</a></li>
diff --git a/content/documentation/javadoc/api/allpackages-index.html b/content/documentation/javadoc/api/allpackages-index.html
index 8e7ac4f..b156527 100644
--- a/content/documentation/javadoc/api/allpackages-index.html
+++ b/content/documentation/javadoc/api/allpackages-index.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>All Packages (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>All Packages (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="All Packages (apache-nutch 1.20 API)";
+ parent.document.title="All Packages (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -623,18 +623,12 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</td>
</tr>
<tr class="rowColor">
-<th class="colFirst" scope="row"><a href="org/apache/nutch/scoring/tld/package-summary.html">org.apache.nutch.scoring.tld</a></th>
-<td class="colLast">
-<div class="block">Top Level Domain Scoring plugin.</div>
-</td>
-</tr>
-<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/scoring/urlmeta/package-summary.html">org.apache.nutch.scoring.urlmeta</a></th>
<td class="colLast">
<div class="block">URL Meta Tag Scoring Plugin</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/scoring/webgraph/package-summary.html">org.apache.nutch.scoring.webgraph</a></th>
<td class="colLast">
<div class="block">Scoring implementation based on link analysis
@@ -642,47 +636,47 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
see <a href="org/apache/nutch/scoring/webgraph/WebGraph.html" title="class in org.apache.nutch.scoring.webgraph"><code>WebGraph</code></a>.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/segment/package-summary.html">org.apache.nutch.segment</a></th>
<td class="colLast">
<div class="block">A segment stores all data from on generate/fetch/update cycle:
fetch list, protocol status, raw content, parsed content, and extracted outgoing links.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/package-summary.html">org.apache.nutch.service</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/impl/package-summary.html">org.apache.nutch.service.impl</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/model/request/package-summary.html">org.apache.nutch.service.model.request</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/model/response/package-summary.html">org.apache.nutch.service.model.response</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/resources/package-summary.html">org.apache.nutch.service.resources</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/tools/package-summary.html">org.apache.nutch.tools</a></th>
<td class="colLast">
<div class="block">Miscellaneous tools.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/tools/arc/package-summary.html">org.apache.nutch.tools.arc</a></th>
<td class="colLast">
<div class="block">Tools to read the
<a href="http://archive.org/web/researcher/ArcFileFormat.php">Arc file format</a>.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/tools/warc/package-summary.html">org.apache.nutch.tools.warc</a></th>
<td class="colLast">
<div class="block">Tools to import / export between Nutch segments and
@@ -690,14 +684,14 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
WARC archives</a>.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/api/package-summary.html">org.apache.nutch.urlfilter.api</a></th>
<td class="colLast">
<div class="block">Generic <a href="org/apache/nutch/net/URLFilter.html" title="interface in org.apache.nutch.net"><code>URL filter</code></a> library,
abstracting away from regular expression implementations.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/automaton/package-summary.html">org.apache.nutch.urlfilter.automaton</a></th>
<td class="colLast">
<div class="block">URL filter plugin based on
@@ -705,70 +699,64 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
Automata for Java<sup>TM</sup>.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/domain/package-summary.html">org.apache.nutch.urlfilter.domain</a></th>
<td class="colLast">
<div class="block">URL filter plugin to include only URLs which match an element in a given list of
domain suffixes, domain names, and/or host names.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/domaindenylist/package-summary.html">org.apache.nutch.urlfilter.domaindenylist</a></th>
<td class="colLast">
<div class="block">URL filter plugin to exclude URLs by domain suffixes, domain names, and/or host names.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/fast/package-summary.html">org.apache.nutch.urlfilter.fast</a></th>
<td class="colLast">
<div class="block">URL filter plugin that first does fast exact suffix matches on host/domain
names before applying regular expressions to the path component of a URL.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/ignoreexempt/package-summary.html">org.apache.nutch.urlfilter.ignoreexempt</a></th>
<td class="colLast">
<div class="block">URL filter plugin which identifies exemptions to external urls when
when external urls are set to ignore.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/prefix/package-summary.html">org.apache.nutch.urlfilter.prefix</a></th>
<td class="colLast">
<div class="block">URL filter plugin to include only URLs which match one of a given list of URL prefixes.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/regex/package-summary.html">org.apache.nutch.urlfilter.regex</a></th>
<td class="colLast">
<div class="block">URL filter plugin to include and/or exclude URLs matching Java regular expressions.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/suffix/package-summary.html">org.apache.nutch.urlfilter.suffix</a></th>
<td class="colLast">
<div class="block">URL filter plugin to either exclude or include only URLs which match
one of the given (path) suffixes.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/validator/package-summary.html">org.apache.nutch.urlfilter.validator</a></th>
<td class="colLast">
<div class="block">URL filter plugin that validates given urls.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="org/apache/nutch/util/package-summary.html">org.apache.nutch.util</a></th>
<td class="colLast">
<div class="block">Miscellaneous utility classes.</div>
</td>
</tr>
-<tr class="altColor">
-<th class="colFirst" scope="row"><a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></th>
-<td class="colLast">
-<div class="block">Classes for domain name analysis.</div>
-</td>
-</tr>
<tr class="rowColor">
<th class="colFirst" scope="row"><a href="org/creativecommons/nutch/package-summary.html">org.creativecommons.nutch</a></th>
<td class="colLast">
@@ -826,7 +814,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/constant-values.html b/content/documentation/javadoc/api/constant-values.html
index dc1c3c2..8adf3b9 100644
--- a/content/documentation/javadoc/api/constant-values.html
+++ b/content/documentation/javadoc/api/constant-values.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Constant Field Values (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Constant Field Values (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Constant Field Values (apache-nutch 1.20 API)";
+ parent.document.title="Constant Field Values (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -1057,13 +1057,20 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<td class="colLast"><code>"hostdb.url.filter"</code></td>
</tr>
<tr class="altColor">
+<td class="colFirst"><a id="org.apache.nutch.hostdb.UpdateHostDb.HOSTDB_URL_LIMIT">
+<!-- -->
+</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
+<th class="colSecond" scope="row"><code><a href="org/apache/nutch/hostdb/UpdateHostDb.html#HOSTDB_URL_LIMIT">HOSTDB_URL_LIMIT</a></code></th>
+<td class="colLast"><code>"hostdb.url.limit"</code></td>
+</tr>
+<tr class="rowColor">
<td class="colFirst"><a id="org.apache.nutch.hostdb.UpdateHostDb.HOSTDB_URL_NORMALIZING">
<!-- -->
</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
<th class="colSecond" scope="row"><code><a href="org/apache/nutch/hostdb/UpdateHostDb.html#HOSTDB_URL_NORMALIZING">HOSTDB_URL_NORMALIZING</a></code></th>
<td class="colLast"><code>"hostdb.url.normalize"</code></td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<td class="colFirst"><a id="org.apache.nutch.hostdb.UpdateHostDb.LOCK_NAME">
<!-- -->
</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
@@ -2523,19 +2530,33 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</tr>
<tbody>
<tr class="altColor">
+<td class="colFirst"><a id="org.apache.nutch.net.protocols.Response.CIPHER_SUITES">
+<!-- -->
+</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
+<th class="colSecond" scope="row"><code><a href="org/apache/nutch/net/protocols/Response.html#CIPHER_SUITES">CIPHER_SUITES</a></code></th>
+<td class="colLast"><code>"_cipher_suites_"</code></td>
+</tr>
+<tr class="rowColor">
<td class="colFirst"><a id="org.apache.nutch.net.protocols.Response.FETCH_TIME">
<!-- -->
</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
<th class="colSecond" scope="row"><code><a href="org/apache/nutch/net/protocols/Response.html#FETCH_TIME">FETCH_TIME</a></code></th>
<td class="colLast"><code>"nutch.fetch.time"</code></td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<td class="colFirst"><a id="org.apache.nutch.net.protocols.Response.IP_ADDRESS">
<!-- -->
</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
<th class="colSecond" scope="row"><code><a href="org/apache/nutch/net/protocols/Response.html#IP_ADDRESS">IP_ADDRESS</a></code></th>
<td class="colLast"><code>"_ip_"</code></td>
</tr>
+<tr class="rowColor">
+<td class="colFirst"><a id="org.apache.nutch.net.protocols.Response.PROTOCOL_VERSIONS">
+<!-- -->
+</a><code>public static final <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
+<th class="colSecond" scope="row"><code><a href="org/apache/nutch/net/protocols/Response.html#PROTOCOL_VERSIONS">PROTOCOL_VERSIONS</a></code></th>
+<td class="colLast"><code>"_protocol_versions_"</code></td>
+</tr>
<tr class="altColor">
<td class="colFirst"><a id="org.apache.nutch.net.protocols.Response.REQUEST">
<!-- -->
@@ -3627,27 +3648,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</table>
</li>
</ul>
-<ul class="blockList">
-<li class="blockList">
-<table class="constantsSummary">
-<caption><span>org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></span><span class="tabEnd"> </span></caption>
-<tr>
-<th class="colFirst" scope="col">Modifier and Type</th>
-<th class="colSecond" scope="col">Constant Field</th>
-<th class="colLast" scope="col">Value</th>
-</tr>
-<tbody>
-<tr class="altColor">
-<td class="colFirst"><a id="org.apache.nutch.util.domain.DomainSuffix.DEFAULT_BOOST">
-<!-- -->
-</a><code>public static final float</code></td>
-<th class="colSecond" scope="row"><code><a href="org/apache/nutch/util/domain/DomainSuffix.html#DEFAULT_BOOST">DEFAULT_BOOST</a></code></th>
-<td class="colLast"><code>1.0f</code></td>
-</tr>
-</tbody>
-</table>
-</li>
-</ul>
</section>
</div>
</main>
@@ -3696,7 +3696,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/deprecated-list.html b/content/documentation/javadoc/api/deprecated-list.html
index 7244158..341fcf5 100644
--- a/content/documentation/javadoc/api/deprecated-list.html
+++ b/content/documentation/javadoc/api/deprecated-list.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Deprecated List (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Deprecated List (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Deprecated List (apache-nutch 1.20 API)";
+ parent.document.title="Deprecated List (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -165,10 +165,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<tr class="altColor">
<th class="colDeprecatedItemName" scope="row"><a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean)">org.apache.nutch.crawl.Generator.generate​(Path, Path, int, long, long, boolean, boolean)</a></th>
<td class="colLast">
-<div class="deprecationComment">since 1.19 use
- <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
- or <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
- in the instance that no hostdb is available</div>
+<div class="deprecationComment">since 1.19 use
+ <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
+ or
+ <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
+ in the instance that no hostdb is available</div>
</td>
</tr>
<tr class="rowColor">
@@ -263,7 +264,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/element-list b/content/documentation/javadoc/api/element-list
index 1500123..e5c799d 100644
--- a/content/documentation/javadoc/api/element-list
+++ b/content/documentation/javadoc/api/element-list
@@ -77,7 +77,6 @@ org.apache.nutch.scoring.orphan
org.apache.nutch.scoring.similarity
org.apache.nutch.scoring.similarity.cosine
org.apache.nutch.scoring.similarity.util
-org.apache.nutch.scoring.tld
org.apache.nutch.scoring.urlmeta
org.apache.nutch.scoring.webgraph
org.apache.nutch.segment
@@ -100,5 +99,4 @@ org.apache.nutch.urlfilter.regex
org.apache.nutch.urlfilter.suffix
org.apache.nutch.urlfilter.validator
org.apache.nutch.util
-org.apache.nutch.util.domain
org.creativecommons.nutch
diff --git a/content/documentation/javadoc/api/help-doc.html b/content/documentation/javadoc/api/help-doc.html
index fc31603..53e4ad1 100644
--- a/content/documentation/javadoc/api/help-doc.html
+++ b/content/documentation/javadoc/api/help-doc.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>API Help (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>API Help (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="API Help (apache-nutch 1.20 API)";
+ parent.document.title="API Help (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -276,7 +276,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/index-all.html b/content/documentation/javadoc/api/index-all.html
index 534916a..8609582 100644
--- a/content/documentation/javadoc/api/index-all.html
+++ b/content/documentation/javadoc/api/index-all.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Index (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Index (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Index (apache-nutch 1.20 API)";
+ parent.document.title="Index (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -620,6 +620,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/okhttp/CIDR.html#%3Cinit%3E(java.net.InetAddress,int)">CIDR(InetAddress, int)</a></span> - Constructor for class org.apache.nutch.protocol.okhttp.<a href="org/apache/nutch/protocol/okhttp/CIDR.html" title="class in org.apache.nutch.protocol.okhttp">CIDR</a></dt>
<dd> </dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/net/protocols/Response.html#CIPHER_SUITES">CIPHER_SUITES</a></span> - Static variable in interface org.apache.nutch.net.protocols.<a href="org/apache/nutch/net/protocols/Response.html" title="interface in org.apache.nutch.net.protocols">Response</a></dt>
+<dd>
+<div class="block">Key to hold the SSL/TLS cipher suites
+ <code>store.protocol.versions</code> is true.</div>
+</dd>
<dt><a href="org/apache/nutch/plugin/CircularDependencyException.html" title="class in org.apache.nutch.plugin"><span class="typeNameLink">CircularDependencyException</span></a> - Exception in <a href="org/apache/nutch/plugin/package-summary.html">org.apache.nutch.plugin</a></dt>
<dd>
<div class="block"><code>CircularDependencyException</code> will be thrown if a circular
@@ -1020,8 +1025,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/FetchOverdueCrawlDatumProcessor.html#count(org.apache.nutch.crawl.CrawlDatum)">count(CrawlDatum)</a></span> - Method in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/FetchOverdueCrawlDatumProcessor.html" title="class in org.apache.nutch.hostdb">FetchOverdueCrawlDatumProcessor</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html#COUNTRY">COUNTRY</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/metadata/DublinCore.html#COVERAGE">COVERAGE</a></span> - Static variable in interface org.apache.nutch.metadata.<a href="org/apache/nutch/metadata/DublinCore.html" title="interface in org.apache.nutch.metadata">DublinCore</a></dt>
<dd>
<div class="block">The extent or scope of the content of the resource.</div>
@@ -1447,8 +1450,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/resources/ConfigResource.html#DEFAULT">DEFAULT</a></span> - Static variable in class org.apache.nutch.service.resources.<a href="org/apache/nutch/service/resources/ConfigResource.html" title="class in org.apache.nutch.service.resources">ConfigResource</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#DEFAULT_BOOST">DEFAULT_BOOST</a></span> - Static variable in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/collection/CollectionManager.html#DEFAULT_FILE_NAME">DEFAULT_FILE_NAME</a></span> - Static variable in class org.apache.nutch.collection.<a href="org/apache/nutch/collection/CollectionManager.html" title="class in org.apache.nutch.collection">CollectionManager</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/fetcher/FetchItemQueues.html#DEFAULT_ID">DEFAULT_ID</a></span> - Static variable in class org.apache.nutch.fetcher.<a href="org/apache/nutch/fetcher/FetchItemQueues.html" title="class in org.apache.nutch.fetcher">FetchItemQueues</a></dt>
@@ -1459,8 +1460,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Wildcard for default plugins.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#DEFAULT_STATUS">DEFAULT_STATUS</a></span> - Static variable in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
-<dd> </dd>
<dt><a href="org/apache/nutch/protocol/interactiveselenium/handlers/DefaultClickAllAjaxLinksHandler.html" title="class in org.apache.nutch.protocol.interactiveselenium.handlers"><span class="typeNameLink">DefaultClickAllAjaxLinksHandler</span></a> - Class in <a href="org/apache/nutch/protocol/interactiveselenium/handlers/package-summary.html">org.apache.nutch.protocol.interactiveselenium.handlers</a></dt>
<dd>
<div class="block">This handler clicks all the <code><a href="./org/apache/nutch/protocol/interactiveselenium/handlers/javascript:void(null);"></a></code> tags
@@ -1536,8 +1535,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Removes the configuration from the list of known configurations.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#DELETED">DELETED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexer/CleaningJob.DeleterReducer.html#%3Cinit%3E()">DeleterReducer()</a></span> - Constructor for class org.apache.nutch.indexer.<a href="org/apache/nutch/indexer/CleaningJob.DeleterReducer.html" title="class in org.apache.nutch.indexer">CleaningJob.DeleterReducer</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/impl/SeedManagerImpl.html#deleteSeedList(java.lang.String)">deleteSeedList(String)</a></span> - Method in class org.apache.nutch.service.impl.<a href="org/apache/nutch/service/impl/SeedManagerImpl.html" title="class in org.apache.nutch.service.impl">SeedManagerImpl</a></dt>
@@ -1552,8 +1549,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyPathRule.html#%3Cinit%3E(java.lang.String)">DenyPathRule(String)</a></span> - Constructor for class org.apache.nutch.urlfilter.fast.<a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyPathRule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.DenyPathRule</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#DEPRECATED">DEPRECATED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/depth/DepthScoringFilter.html#DEPTH_KEY">DEPTH_KEY</a></span> - Static variable in class org.apache.nutch.scoring.depth.<a href="org/apache/nutch/scoring/depth/DepthScoringFilter.html" title="class in org.apache.nutch.scoring.depth">DepthScoringFilter</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/depth/DepthScoringFilter.html#DEPTH_KEY_W">DEPTH_KEY_W</a></span> - Static variable in class org.apache.nutch.scoring.depth.<a href="org/apache/nutch/scoring/depth/DepthScoringFilter.html" title="class in org.apache.nutch.scoring.depth">DepthScoringFilter</a></dt>
@@ -1688,36 +1683,18 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/urlfilter/domaindenylist/DomainDenylistURLFilter.html#%3Cinit%3E()">DomainDenylistURLFilter()</a></span> - Constructor for class org.apache.nutch.urlfilter.domaindenylist.<a href="org/apache/nutch/urlfilter/domaindenylist/DomainDenylistURLFilter.html" title="class in org.apache.nutch.urlfilter.domaindenylist">DomainDenylistURLFilter</a></dt>
<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/DomainStatistics.html" title="class in org.apache.nutch.util.domain"><span class="typeNameLink">DomainStatistics</span></a> - Class in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
+<dt><a href="org/apache/nutch/util/DomainStatistics.html" title="class in org.apache.nutch.util"><span class="typeNameLink">DomainStatistics</span></a> - Class in <a href="org/apache/nutch/util/package-summary.html">org.apache.nutch.util</a></dt>
<dd>
<div class="block">Extracts some very basic statistics about domains from the crawldb</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.html#%3Cinit%3E()">DomainStatistics()</a></span> - Constructor for class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.html" title="class in org.apache.nutch.util.domain">DomainStatistics</a></dt>
-<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util.domain"><span class="typeNameLink">DomainStatistics.DomainStatisticsCombiner</span></a> - Class in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
-<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain"><span class="typeNameLink">DomainStatistics.MyCounter</span></a> - Enum in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.html#%3Cinit%3E()">DomainStatistics()</a></span> - Constructor for class org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.html" title="class in org.apache.nutch.util">DomainStatistics</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html#%3Cinit%3E()">DomainStatisticsCombiner()</a></span> - Constructor for class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util.domain">DomainStatistics.DomainStatisticsCombiner</a></dt>
+<dt><a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util"><span class="typeNameLink">DomainStatistics.DomainStatisticsCombiner</span></a> - Class in <a href="org/apache/nutch/util/package-summary.html">org.apache.nutch.util</a></dt>
<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain"><span class="typeNameLink">DomainSuffix</span></a> - Class in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
-<dd>
-<div class="block">This class represents the last part of the host name, which is operated by
- authoritives, not individuals.</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#%3Cinit%3E(java.lang.String)">DomainSuffix(String)</a></span> - Constructor for class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
+<dt><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util"><span class="typeNameLink">DomainStatistics.MyCounter</span></a> - Enum in <a href="org/apache/nutch/util/package-summary.html">org.apache.nutch.util</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#%3Cinit%3E(java.lang.String,org.apache.nutch.util.domain.DomainSuffix.Status,float)">DomainSuffix(String, DomainSuffix.Status, float)</a></span> - Constructor for class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html#%3Cinit%3E()">DomainStatisticsCombiner()</a></span> - Constructor for class org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util">DomainStatistics.DomainStatisticsCombiner</a></dt>
<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain"><span class="typeNameLink">DomainSuffix.Status</span></a> - Enum in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
-<dd>
-<div class="block">Enumeration of the status of the tld.</div>
-</dd>
-<dt><a href="org/apache/nutch/util/domain/DomainSuffixes.html" title="class in org.apache.nutch.util.domain"><span class="typeNameLink">DomainSuffixes</span></a> - Class in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
-<dd>
-<div class="block">Storage class for <code>DomainSuffix</code> objects Note: this class is
- singleton</div>
-</dd>
<dt><a href="org/apache/nutch/urlfilter/domain/DomainURLFilter.html" title="class in org.apache.nutch.urlfilter.domain"><span class="typeNameLink">DomainURLFilter</span></a> - Class in <a href="org/apache/nutch/urlfilter/domain/package-summary.html">org.apache.nutch.urlfilter.domain</a></dt>
<dd>
<div class="block">
@@ -1878,7 +1855,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/html/DOMContentUtils.LinkParams.html#elName">elName</a></span> - Variable in class org.apache.nutch.parse.html.<a href="org/apache/nutch/parse/html/DOMContentUtils.LinkParams.html" title="class in org.apache.nutch.parse.html">DOMContentUtils.LinkParams</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html#EMPTY_RESULT">EMPTY_RESULT</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html#EMPTY_RESULT">EMPTY_RESULT</a></span> - org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/RobotRulesParser.html#EMPTY_RULES">EMPTY_RULES</a></span> - Static variable in class org.apache.nutch.protocol.<a href="org/apache/nutch/protocol/RobotRulesParser.html" title="class in org.apache.nutch.protocol">RobotRulesParser</a></dt>
<dd>
@@ -2004,8 +1981,9 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><a href="org/apache/nutch/urlfilter/ignoreexempt/ExemptionUrlFilter.html" title="class in org.apache.nutch.urlfilter.ignoreexempt"><span class="typeNameLink">ExemptionUrlFilter</span></a> - Class in <a href="org/apache/nutch/urlfilter/ignoreexempt/package-summary.html">org.apache.nutch.urlfilter.ignoreexempt</a></dt>
<dd>
-<div class="block">This implementation of <a href="org/apache/nutch/net/URLExemptionFilter.html" title="interface in org.apache.nutch.net"><code>URLExemptionFilter</code></a> uses regex configuration
- to check if URL is eligible for exemption from 'db.ignore.external'.</div>
+<div class="block">This implementation of <a href="org/apache/nutch/net/URLExemptionFilter.html" title="interface in org.apache.nutch.net"><code>URLExemptionFilter</code></a>
+ uses regex configuration to check if URL is eligible for exemption from
+ the <code>db.ignore.external.links</code> configuration property.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/urlfilter/ignoreexempt/ExemptionUrlFilter.html#%3Cinit%3E()">ExemptionUrlFilter()</a></span> - Constructor for class org.apache.nutch.urlfilter.ignoreexempt.<a href="org/apache/nutch/urlfilter/ignoreexempt/ExemptionUrlFilter.html" title="class in org.apache.nutch.urlfilter.ignoreexempt">ExemptionUrlFilter</a></dt>
<dd> </dd>
@@ -2159,7 +2137,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/segment/SegmentReader.SegmentReaderStats.html#fetched">fetched</a></span> - Variable in class org.apache.nutch.segment.<a href="org/apache/nutch/segment/SegmentReader.SegmentReaderStats.html" title="class in org.apache.nutch.segment">SegmentReader.SegmentReaderStats</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html#FETCHED">FETCHED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html#FETCHED">FETCHED</a></span> - org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></dt>
<dd> </dd>
<dt><a href="org/apache/nutch/fetcher/Fetcher.html" title="class in org.apache.nutch.fetcher"><span class="typeNameLink">Fetcher</span></a> - Class in <a href="org/apache/nutch/fetcher/package-summary.html">org.apache.nutch.fetcher</a></dt>
<dd>
@@ -2672,10 +2650,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean)">generate(Path, Path, int, long, long, boolean, boolean)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/Generator.html" title="class in org.apache.nutch.crawl">Generator</a></dt>
<dd>
<div class="deprecationBlock"><span class="deprecatedLabel">Deprecated.</span>
-<div class="deprecationComment">since 1.19 use
- <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
- or <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
- in the instance that no hostdb is available</div>
+<div class="deprecationComment">since 1.19 use
+ <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
+ or
+ <a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>Generator.generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
+ in the instance that no hostdb is available</div>
</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/Generator.html#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)">generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/Generator.html" title="class in org.apache.nutch.crawl">Generator</a></dt>
@@ -2718,7 +2697,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><a href="org/apache/nutch/crawl/Generator.html" title="class in org.apache.nutch.crawl"><span class="typeNameLink">Generator</span></a> - Class in <a href="org/apache/nutch/crawl/package-summary.html">org.apache.nutch.crawl</a></dt>
<dd>
-<div class="block">Generates a subset of a crawl db to fetch.</div>
+<div class="block">Generates a subset of a CrawlDb to fetch.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/Generator.html#%3Cinit%3E()">Generator()</a></span> - Constructor for class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/Generator.html" title="class in org.apache.nutch.crawl">Generator</a></dt>
<dd> </dd>
@@ -2809,8 +2788,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Calculate a sort value for Generate.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html#GENERIC">GENERIC</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></dt>
-<dd> </dd>
<dt><a href="org/apache/nutch/util/GenericWritableConfigurable.html" title="class in org.apache.nutch.util"><span class="typeNameLink">GenericWritableConfigurable</span></a> - Class in <a href="org/apache/nutch/util/package-summary.html">org.apache.nutch.util</a></dt>
<dd>
<div class="block">A generic Writable wrapper that can inject Configuration to
@@ -2855,12 +2832,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Returns the configuration associatedConfManagerImpl with the given confId</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffixes.html#get(java.lang.String)">get(String)</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffixes.html" title="class in org.apache.nutch.util.domain">DomainSuffixes</a></dt>
-<dd>
-<div class="block">Return the <a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain"><code>DomainSuffix</code></a> object for the extension, if extension is a
- top level domain returned object will be an instance of
- <a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain"><code>TopLevelDomain</code></a></div>
-</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexer/IndexWriterParams.html#get(java.lang.String,java.lang.String)">get(String, String)</a></span> - Method in class org.apache.nutch.indexer.<a href="org/apache/nutch/indexer/IndexWriterParams.html" title="class in org.apache.nutch.indexer">IndexWriterParams</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/impl/JobManagerImpl.html#get(java.lang.String,java.lang.String)">get(String, String)</a></span> - Method in class org.apache.nutch.service.impl.<a href="org/apache/nutch/service/impl/JobManagerImpl.html" title="class in org.apache.nutch.service.impl">JobManagerImpl</a></dt>
@@ -2981,8 +2952,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexer/IndexWriterParams.html#getBoolean(java.lang.String,boolean)">getBoolean(String, boolean)</a></span> - Method in class org.apache.nutch.indexer.<a href="org/apache/nutch/indexer/IndexWriterParams.html" title="class in org.apache.nutch.indexer">IndexWriterParams</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#getBoost()">getBoost()</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/ftp/Ftp.html#getBufferSize()">getBufferSize()</a></span> - Method in class org.apache.nutch.protocol.ftp.<a href="org/apache/nutch/protocol/ftp/Ftp.html" title="class in org.apache.nutch.protocol.ftp">Ftp</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/plugin/PluginRepository.html#getCachedClass(org.apache.nutch.plugin.PluginDescriptor,java.lang.String)">getCachedClass(PluginDescriptor, String)</a></span> - Method in class org.apache.nutch.plugin.<a href="org/apache/nutch/plugin/PluginRepository.html" title="class in org.apache.nutch.plugin">PluginRepository</a></dt>
@@ -3282,10 +3251,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/httpclient/HttpFormAuthentication.html#getCookies()">getCookies()</a></span> - Method in class org.apache.nutch.protocol.httpclient.<a href="org/apache/nutch/protocol/httpclient/HttpFormAuthentication.html" title="class in org.apache.nutch.protocol.httpclient">HttpFormAuthentication</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.html#getCountryName()">getCountryName()</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain">TopLevelDomain</a></dt>
-<dd>
-<div class="block">Returns the country name if TLD is Country Code TLD</div>
-</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/model/request/DbQuery.html#getCrawlId()">getCrawlId()</a></span> - Method in class org.apache.nutch.service.model.request.<a href="org/apache/nutch/service/model/request/DbQuery.html" title="class in org.apache.nutch.service.model.request">DbQuery</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/model/request/JobConfig.html#getCrawlId()">getCrawlId()</a></span> - Method in class org.apache.nutch.service.model.request.<a href="org/apache/nutch/service/model/request/JobConfig.html" title="class in org.apache.nutch.service.model.request">JobConfig</a></dt>
@@ -3314,6 +3279,14 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/tools/arc/ArcRecordReader.html#getCurrentValue()">getCurrentValue()</a></span> - Method in class org.apache.nutch.tools.arc.<a href="org/apache/nutch/tools/arc/ArcRecordReader.html" title="class in org.apache.nutch.tools.arc">ArcRecordReader</a></dt>
<dd> </dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html#getCustomMaxInterval(org.apache.hadoop.io.Text)">getCustomMaxInterval(Text)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></dt>
+<dd>
+<div class="block">Returns the custom max.</div>
+</dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html#getCustomMinInterval(org.apache.hadoop.io.Text)">getCustomMinInterval(Text)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></dt>
+<dd>
+<div class="block">Returns the custom min.</div>
+</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/okhttp/OkHttp.html#getCustomRequestHeaders()">getCustomRequestHeaders()</a></span> - Method in class org.apache.nutch.protocol.okhttp.<a href="org/apache/nutch/protocol/okhttp/OkHttp.html" title="class in org.apache.nutch.protocol.okhttp">OkHttp</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/Parse.html#getData()">getData()</a></span> - Method in interface org.apache.nutch.parse.<a href="org/apache/nutch/parse/Parse.html" title="interface in org.apache.nutch.parse">Parse</a></dt>
@@ -3344,25 +3317,23 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Returns parsed dom tree or null if any error</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#getDomain()">getDomain()</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getDomainName(java.lang.String)">getDomainName(String)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns the domain name of the url.</div>
+<div class="block">Returns the domain name of the URL.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getDomainName(java.net.URL)">getDomainName(URL)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Get the domain name of the url.</div>
+<div class="block">Get the domain name of the URL.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getDomainSuffix(java.lang.String)">getDomainSuffix(String)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns the <a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain"><code>DomainSuffix</code></a> corresponding to the last public part of
- the hostname</div>
+<div class="block">Returns the domain suffix corresponding to the last public part of the
+ hostname.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getDomainSuffix(java.net.URL)">getDomainSuffix(URL)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns the <a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain"><code>DomainSuffix</code></a> corresponding to the last public part of
- the hostname</div>
+<div class="block">Returns the public suffix corresponding to the last public part of the
+ hostname.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/htmlunit/HtmlUnitWebDriver.html#getDriverForPage(java.lang.String,org.apache.hadoop.conf.Configuration)">getDriverForPage(String, Configuration)</a></span> - Static method in class org.apache.nutch.protocol.htmlunit.<a href="org/apache/nutch/protocol/htmlunit/HtmlUnitWebDriver.html" title="class in org.apache.nutch.protocol.htmlunit">HtmlUnitWebDriver</a></dt>
<dd> </dd>
@@ -3512,8 +3483,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getHost(java.lang.String)">getHost(String)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns the lowercased hostname for the URL or null if the URL is not well-formed
- formed.</div>
+<div class="block">Returns the lowercased hostname for the URL or null if the URL is not well-formed.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getHost(java.net.URL)">getHost(URL)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
@@ -3523,7 +3493,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html#getHostName(java.lang.String)">getHostName(String)</a></span> - Static method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></dt>
<dd>
-<div class="block">Strip a URL, leaving only the host name.</div>
+<div class="block">Strip a URL, leaving only the hostname.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getHostSegments(java.lang.String)">getHostSegments(String)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
@@ -3609,10 +3579,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyAllRule.html#getInstance()">getInstance()</a></span> - Static method in class org.apache.nutch.urlfilter.fast.<a href="org/apache/nutch/urlfilter/fast/FastURLFilter.DenyAllRule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.DenyAllRule</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffixes.html#getInstance()">getInstance()</a></span> - Static method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffixes.html" title="class in org.apache.nutch.util.domain">DomainSuffixes</a></dt>
-<dd>
-<div class="block">Singleton instance, lazy instantination</div>
-</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/exchange/ExchangeConfig.html#getInstance(org.w3c.dom.Element)">getInstance(Element)</a></span> - Static method in class org.apache.nutch.exchange.<a href="org/apache/nutch/exchange/ExchangeConfig.html" title="class in org.apache.nutch.exchange">ExchangeConfig</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexer/IndexWriterParams.html#getInt(java.lang.String,int)">getInt(String, int)</a></span> - Method in class org.apache.nutch.indexer.<a href="org/apache/nutch/indexer/IndexWriterParams.html" title="class in org.apache.nutch.indexer">IndexWriterParams</a></dt>
@@ -3697,10 +3663,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">The time limit to download the entire content, in seconds.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html#getMaxInterval(org.apache.hadoop.io.Text,float)">getMaxInterval(Text, float)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></dt>
-<dd>
-<div class="block">Returns the max_interval for this URL, which might depend on the host.</div>
-</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/ParseStatus.html#getMessage()">getMessage()</a></span> - Method in class org.apache.nutch.parse.<a href="org/apache/nutch/parse/ParseStatus.html" title="class in org.apache.nutch.parse">ParseStatus</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/ProtocolStatus.html#getMessage()">getMessage()</a></span> - Method in class org.apache.nutch.protocol.<a href="org/apache/nutch/protocol/ProtocolStatus.html" title="class in org.apache.nutch.protocol">ProtocolStatus</a></dt>
@@ -3713,6 +3675,8 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Get a metadata single value.</div>
</dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/Inlink.html#getMetadata()">getMetadata()</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/Inlink.html" title="class in org.apache.nutch.crawl">Inlink</a></dt>
+<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/metadata/MetaWrapper.html#getMetadata()">getMetadata()</a></span> - Method in class org.apache.nutch.metadata.<a href="org/apache/nutch/metadata/MetaWrapper.html" title="class in org.apache.nutch.metadata">MetaWrapper</a></dt>
<dd>
<div class="block">Get all metadata.</div>
@@ -3759,10 +3723,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<div class="block">Facade interface to Tika's underlying <code>MimeTypes.getMimeType(String)</code>
method.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html#getMinInterval(org.apache.hadoop.io.Text,float)">getMinInterval(Text, float)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></dt>
-<dd>
-<div class="block">Returns the min_interval for this URL, which might depend on the host.</div>
-</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/ParseStatus.html#getMinorCode()">getMinorCode()</a></span> - Method in class org.apache.nutch.parse.<a href="org/apache/nutch/parse/ParseStatus.html" title="class in org.apache.nutch.parse">ParseStatus</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/CrawlDatum.html#getModifiedTime()">getModifiedTime()</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/CrawlDatum.html" title="class in org.apache.nutch.crawl">CrawlDatum</a></dt>
@@ -4281,8 +4241,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/model/response/FetchNodeDbInfo.html#getStatus()">getStatus()</a></span> - Method in class org.apache.nutch.service.model.response.<a href="org/apache/nutch/service/model/response/FetchNodeDbInfo.html" title="class in org.apache.nutch.service.model.response">FetchNodeDbInfo</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#getStatus()">getStatus()</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/NutchTool.html#getStatus()">getStatus()</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/NutchTool.html" title="class in org.apache.nutch.util">NutchTool</a></dt>
<dd>
<div class="block">Returns current status of the running tool</div>
@@ -4327,7 +4285,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/tika/DOMContentUtils.html#getText(java.lang.StringBuffer,org.w3c.dom.Node)">getText(StringBuffer, Node)</a></span> - Method in class org.apache.nutch.parse.tika.<a href="org/apache/nutch/parse/tika/DOMContentUtils.html" title="class in org.apache.nutch.parse.tika">DOMContentUtils</a></dt>
<dd>
<div class="block">This is a convinience method, equivalent to
- <a href="org/apache/nutch/parse/tika/DOMContentUtils.html#getText(java.lang.StringBuffer,org.w3c.dom.Node,boolean)"><code>getText(sb, node, false)</code></a>.</div>
+ <code>getText(sb, node, false)</code>.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/html/DOMContentUtils.html#getText(java.lang.StringBuffer,org.w3c.dom.Node,boolean)">getText(StringBuffer, Node, boolean)</a></span> - Method in class org.apache.nutch.parse.html.<a href="org/apache/nutch/parse/html/DOMContentUtils.html" title="class in org.apache.nutch.parse.html">DOMContentUtils</a></dt>
<dd>
@@ -4379,11 +4337,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getTopLevelDomainName(java.lang.String)">getTopLevelDomainName(String)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns the top level domain name of the url.</div>
+<div class="block">Returns the top-level domain name of the URL.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#getTopLevelDomainName(java.net.URL)">getTopLevelDomainName(URL)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns the top level domain name of the url.</div>
+<div class="block">Returns the top-level domain name of the URL.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/fetcher/FetchItemQueues.html#getTotalSize()">getTotalSize()</a></span> - Method in class org.apache.nutch.fetcher.<a href="org/apache/nutch/fetcher/FetchItemQueues.html" title="class in org.apache.nutch.fetcher">FetchItemQueues</a></dt>
<dd> </dd>
@@ -4395,8 +4353,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/service/model/response/JobInfo.html#getType()">getType()</a></span> - Method in class org.apache.nutch.service.model.response.<a href="org/apache/nutch/service/model/response/JobInfo.html" title="class in org.apache.nutch.service.model.response">JobInfo</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.html#getType()">getType()</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain">TopLevelDomain</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/NutchWritable.html#getTypes()">getTypes()</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/NutchWritable.html" title="class in org.apache.nutch.crawl">NutchWritable</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/HostDatum.html#getUnfetched()">getUnfetched()</a></span> - Method in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/HostDatum.html" title="class in org.apache.nutch.hostdb">HostDatum</a></dt>
@@ -4618,6 +4574,8 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDb.html#HOSTDB_URL_FILTERING">HOSTDB_URL_FILTERING</a></span> - Static variable in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDb.html" title="class in org.apache.nutch.hostdb">UpdateHostDb</a></dt>
<dd> </dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDb.html#HOSTDB_URL_LIMIT">HOSTDB_URL_LIMIT</a></span> - Static variable in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDb.html" title="class in org.apache.nutch.hostdb">UpdateHostDb</a></dt>
+<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDb.html#HOSTDB_URL_NORMALIZING">HOSTDB_URL_NORMALIZING</a></span> - Static variable in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDb.html" title="class in org.apache.nutch.hostdb">UpdateHostDb</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/tools/WARCUtils.html#HOSTNAME">HOSTNAME</a></span> - Static variable in class org.apache.nutch.tools.<a href="org/apache/nutch/tools/WARCUtils.html" title="class in org.apache.nutch.tools">WARCUtils</a></dt>
@@ -4894,8 +4852,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/tools/arc/ArcRecordReader.html#in">in</a></span> - Variable in class org.apache.nutch.tools.arc.<a href="org/apache/nutch/tools/arc/ArcRecordReader.html" title="class in org.apache.nutch.tools.arc">ArcRecordReader</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#IN_USE">IN_USE</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html#INC_RATE">INC_RATE</a></span> - Variable in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/HostDatum.html#incConnectionFailures()">incConnectionFailures()</a></span> - Method in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/HostDatum.html" title="class in org.apache.nutch.hostdb">HostDatum</a></dt>
@@ -4973,8 +4929,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/ScoringFilters.html#indexerScore(org.apache.hadoop.io.Text,org.apache.nutch.indexer.NutchDocument,org.apache.nutch.crawl.CrawlDatum,org.apache.nutch.crawl.CrawlDatum,org.apache.nutch.parse.Parse,org.apache.nutch.crawl.Inlinks,float)">indexerScore(Text, NutchDocument, CrawlDatum, CrawlDatum, Parse, Inlinks, float)</a></span> - Method in class org.apache.nutch.scoring.<a href="org/apache/nutch/scoring/ScoringFilters.html" t [...]
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/tld/TLDScoringFilter.html#indexerScore(org.apache.hadoop.io.Text,org.apache.nutch.indexer.NutchDocument,org.apache.nutch.crawl.CrawlDatum,org.apache.nutch.crawl.CrawlDatum,org.apache.nutch.parse.Parse,org.apache.nutch.crawl.Inlinks,float)">indexerScore(Text, NutchDocument, CrawlDatum, CrawlDatum, Parse, Inlinks, float)</a></span> - Method in class org.apache.nutch.scoring.tld.<a href="org/apache/nutch/scoring/tld/TLDScori [...]
-<dd> </dd>
<dt><a href="org/apache/nutch/indexer/IndexingException.html" title="class in org.apache.nutch.indexer"><span class="typeNameLink">IndexingException</span></a> - Exception in <a href="org/apache/nutch/indexer/package-summary.html">org.apache.nutch.indexer</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexer/IndexingException.html#%3Cinit%3E()">IndexingException()</a></span> - Constructor for exception org.apache.nutch.indexer.<a href="org/apache/nutch/indexer/IndexingException.html" title="class in org.apache.nutch.indexer">IndexingException</a></dt>
@@ -5046,10 +5000,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<div class="block">Returns an inflated copy of the input array, truncated to
<code>sizeLimit</code> bytes, if necessary.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#INFRASTRUCTURE">INFRASTRUCTURE</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html#INFRASTRUCTURE">INFRASTRUCTURE</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/collection/CollectionManager.html#init()">init()</a></span> - Method in class org.apache.nutch.collection.<a href="org/apache/nutch/collection/CollectionManager.html" title="class in org.apache.nutch.collection">CollectionManager</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/LinkDbReader.html#init(org.apache.hadoop.fs.Path)">init(Path)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/LinkDbReader.html" title="class in org.apache.nutch.crawl">LinkDbReader</a></dt>
@@ -5228,10 +5178,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/http/api/HttpBase.html#isCookieEnabled()">isCookieEnabled()</a></span> - Method in class org.apache.nutch.protocol.http.api.<a href="org/apache/nutch/protocol/http/api/HttpBase.html" title="class in org.apache.nutch.protocol.http.api">HttpBase</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffixes.html#isDomainSuffix(java.lang.String)">isDomainSuffix(String)</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffixes.html" title="class in org.apache.nutch.util.domain">DomainSuffixes</a></dt>
-<dd>
-<div class="block">Return whether the extension is a registered domain entry</div>
-</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html#isEligibleForCheck(org.apache.nutch.hostdb.HostDatum)">isEligibleForCheck(HostDatum)</a></span> - Method in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html" title="class in org.apache.nutch.hostdb">UpdateHostDbReducer</a></dt>
<dd>
<div class="block">Determines whether a record is eligible for recheck.</div>
@@ -5304,11 +5250,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#isSameDomainName(java.lang.String,java.lang.String)">isSameDomainName(String, String)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns whether the given urls have the same domain name.</div>
+<div class="block">Returns whether the given URLs have the same domain name.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/URLUtil.html#isSameDomainName(java.net.URL,java.net.URL)">isSameDomainName(URL, URL)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/URLUtil.html" title="class in org.apache.nutch.util">URLUtil</a></dt>
<dd>
-<div class="block">Returns whether the given urls have the same domain name.</div>
+<div class="block">Returns whether the given URLs have the same domain name.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/htmlunit/DummyX509TrustManager.html#isServerTrusted(java.security.cert.X509Certificate%5B%5D)">isServerTrusted(X509Certificate[])</a></span> - Method in class org.apache.nutch.protocol.htmlunit.<a href="org/apache/nutch/protocol/htmlunit/DummyX509TrustManager.html" title="class in org.apache.nutch.protocol.htmlunit">DummyX509TrustManager</a></dt>
<dd> </dd>
@@ -6021,7 +5967,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/CrawlCompletionStats.html#main(java.lang.String%5B%5D)">main(String[])</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/CrawlCompletionStats.html" title="class in org.apache.nutch.util">CrawlCompletionStats</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.html#main(java.lang.String%5B%5D)">main(String[])</a></span> - Static method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.html" title="class in org.apache.nutch.util.domain">DomainStatistics</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.html#main(java.lang.String%5B%5D)">main(String[])</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.html" title="class in org.apache.nutch.util">DomainStatistics</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/EncodingDetector.html#main(java.lang.String%5B%5D)">main(String[])</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/EncodingDetector.html" title="class in org.apache.nutch.util">EncodingDetector</a></dt>
<dd> </dd>
@@ -6499,9 +6445,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/ParserChecker.html#normalizers">normalizers</a></span> - Variable in class org.apache.nutch.parse.<a href="org/apache/nutch/parse/ParserChecker.html" title="class in org.apache.nutch.parse">ParserChecker</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html#NOT_FETCHED">NOT_FETCHED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></dt>
-<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#NOT_IN_USE">NOT_IN_USE</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html#NOT_FETCHED">NOT_FETCHED</a></span> - org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/net/protocols/Response.TruncatedContentReason.html#NOT_TRUNCATED">NOT_TRUNCATED</a></span> - org.apache.nutch.net.protocols.<a href="org/apache/nutch/net/protocols/Response.TruncatedContentReason.html" title="enum in org.apache.nutch.net.protocols">Response.TruncatedContentReason</a></dt>
<dd> </dd>
@@ -7114,10 +7058,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Utility package for Lucene functions.</div>
</dd>
-<dt><a href="org/apache/nutch/scoring/tld/package-summary.html">org.apache.nutch.scoring.tld</a> - package org.apache.nutch.scoring.tld</dt>
-<dd>
-<div class="block">Top Level Domain Scoring plugin.</div>
-</dd>
<dt><a href="org/apache/nutch/scoring/urlmeta/package-summary.html">org.apache.nutch.scoring.urlmeta</a> - package org.apache.nutch.scoring.urlmeta</dt>
<dd>
<div class="block">URL Meta Tag Scoring Plugin</div>
@@ -7209,10 +7149,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Miscellaneous utility classes.</div>
</dd>
-<dt><a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a> - package org.apache.nutch.util.domain</dt>
-<dd>
-<div class="block">Classes for domain name analysis.</div>
-</dd>
<dt><a href="org/creativecommons/nutch/package-summary.html">org.creativecommons.nutch</a> - package org.creativecommons.nutch</dt>
<dd>
<div class="block">Sample plugins that parse and index Creative Commons metadata.</div>
@@ -7709,8 +7645,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/CrawlDbReader.html#processTopNJob(java.lang.String,long,float,java.lang.String,org.apache.hadoop.conf.Configuration)">processTopNJob(String, long, float, String, Configuration)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/CrawlDbReader.html" title="class in org.apache.nutch.crawl">CrawlDbReader</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#PROPOSED">PROPOSED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/ProtocolStatus.html#PROTO_NOT_FOUND">PROTO_NOT_FOUND</a></span> - Static variable in class org.apache.nutch.protocol.<a href="org/apache/nutch/protocol/ProtocolStatus.html" title="class in org.apache.nutch.protocol">ProtocolStatus</a></dt>
<dd>
<div class="block">This protocol was not found.</div>
@@ -7725,6 +7659,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/metadata/Nutch.html#PROTOCOL_STATUS_CODE_KEY">PROTOCOL_STATUS_CODE_KEY</a></span> - Static variable in interface org.apache.nutch.metadata.<a href="org/apache/nutch/metadata/Nutch.html" title="interface in org.apache.nutch.metadata">Nutch</a></dt>
<dd> </dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/net/protocols/Response.html#PROTOCOL_VERSIONS">PROTOCOL_VERSIONS</a></span> - Static variable in interface org.apache.nutch.net.protocols.<a href="org/apache/nutch/net/protocols/Response.html" title="interface in org.apache.nutch.net.protocols">Response</a></dt>
+<dd>
+<div class="block">Key to hold the HTTP and SSL/TLS protocol versions if
+ <code>store.protocol.versions</code> is true.</div>
+</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/ftp/PrintCommandListener.html#protocolCommandSent(org.apache.commons.net.ProtocolCommandEvent)">protocolCommandSent(ProtocolCommandEvent)</a></span> - Method in class org.apache.nutch.protocol.ftp.<a href="org/apache/nutch/protocol/ftp/PrintCommandListener.html" title="class in org.apache.nutch.protocol.ftp">PrintCommandListener</a></dt>
<dd> </dd>
<dt><a href="org/apache/nutch/net/protocols/ProtocolException.html" title="class in org.apache.nutch.net.protocols"><span class="typeNameLink">ProtocolException</span></a> - Exception in <a href="org/apache/nutch/net/protocols/package-summary.html">org.apache.nutch.net.protocols</a></dt>
@@ -7837,8 +7776,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">The proxy port.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#PSEUDO_DOMAIN">PSEUDO_DOMAIN</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/publisher/NutchPublisher.html#publish(java.lang.Object,org.apache.hadoop.conf.Configuration)">publish(Object, Configuration)</a></span> - Method in interface org.apache.nutch.publisher.<a href="org/apache/nutch/publisher/NutchPublisher.html" title="interface in org.apache.nutch.publisher">NutchPublisher</a></dt>
<dd>
<div class="block">This method publishes the event.</div>
@@ -8066,7 +8003,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/CrawlCompletionStats.CrawlCompletionStatsCombiner.html#reduce(org.apache.hadoop.io.Text,java.lang.Iterable,org.apache.hadoop.mapreduce.Reducer.Context)">reduce(Text, Iterable<LongWritable>, Reducer.Context)</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/CrawlCompletionStats.CrawlCompletionStatsCombiner.html" title="class in org.apache.nutch.util">CrawlCompletionStats.CrawlCompletionSt [...]
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html#reduce(org.apache.hadoop.io.Text,java.lang.Iterable,org.apache.hadoop.mapreduce.Reducer.Context)">reduce(Text, Iterable<LongWritable>, Reducer.Context)</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util.domain">DomainStatistics.DomainSta [...]
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html#reduce(org.apache.hadoop.io.Text,java.lang.Iterable,org.apache.hadoop.mapreduce.Reducer.Context)">reduce(Text, Iterable<LongWritable>, Reducer.Context)</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.DomainStatisticsCombiner.html" title="class in org.apache.nutch.util">DomainStatistics.DomainStatisticsCombiner</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/ProtocolStatusStatistics.ProtocolStatusStatisticsCombiner.html#reduce(org.apache.hadoop.io.Text,java.lang.Iterable,org.apache.hadoop.mapreduce.Reducer.Context)">reduce(Text, Iterable<LongWritable>, Reducer.Context)</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/ProtocolStatusStatistics.ProtocolStatusStatisticsCombiner.html" title="class in org.apache.nutch.util">ProtocolStatusStatisti [...]
<dd> </dd>
@@ -8196,8 +8133,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Use this method once a new PluginRepository was created to register it.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#REJECTED">REJECTED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/microformats/reltag/RelTagParser.html#REL_TAG">REL_TAG</a></span> - Static variable in class org.apache.nutch.microformats.reltag.<a href="org/apache/nutch/microformats/reltag/RelTagParser.html" title="class in org.apache.nutch.microformats.reltag">RelTagParser</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/metadata/DublinCore.html#RELATION">RELATION</a></span> - Static variable in interface org.apache.nutch.metadata.<a href="org/apache/nutch/metadata/DublinCore.html" title="interface in org.apache.nutch.metadata">DublinCore</a></dt>
@@ -8484,7 +8419,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/CrawlCompletionStats.html#run(java.lang.String%5B%5D)">run(String[])</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/CrawlCompletionStats.html" title="class in org.apache.nutch.util">CrawlCompletionStats</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.html#run(java.lang.String%5B%5D)">run(String[])</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.html" title="class in org.apache.nutch.util.domain">DomainStatistics</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.html#run(java.lang.String%5B%5D)">run(String[])</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.html" title="class in org.apache.nutch.util">DomainStatistics</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/ProtocolStatusStatistics.html#run(java.lang.String%5B%5D)">run(String[])</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/ProtocolStatusStatistics.html" title="class in org.apache.nutch.util">ProtocolStatusStatistics</a></dt>
<dd> </dd>
@@ -9305,6 +9240,8 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Set metadata.</div>
</dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/Inlink.html#setMetadata(org.apache.hadoop.io.MapWritable)">setMetadata(MapWritable)</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/Inlink.html" title="class in org.apache.nutch.crawl">Inlink</a></dt>
+<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/parse/Outlink.html#setMetadata(org.apache.hadoop.io.MapWritable)">setMetadata(MapWritable)</a></span> - Method in class org.apache.nutch.parse.<a href="org/apache/nutch/parse/Outlink.html" title="class in org.apache.nutch.parse">Outlink</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/Content.html#setMetadata(org.apache.nutch.metadata.Metadata)">setMetadata(Metadata)</a></span> - Method in class org.apache.nutch.protocol.<a href="org/apache/nutch/protocol/Content.html" title="class in org.apache.nutch.protocol">Content</a></dt>
@@ -9467,14 +9404,18 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/similarity/cosine/DocVector.html#setTermFreqVector(java.util.HashMap)">setTermFreqVector(HashMap<String, Integer>)</a></span> - Method in class org.apache.nutch.scoring.similarity.cosine.<a href="org/apache/nutch/scoring/similarity/cosine/DocVector.html" title="class in org.apache.nutch.scoring.similarity.cosine">DocVector</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/fetcher/QueueFeeder.html#setTimeLimit(long)">setTimeLimit(long)</a></span> - Method in class org.apache.nutch.fetcher.<a href="org/apache/nutch/fetcher/QueueFeeder.html" title="class in org.apache.nutch.fetcher">QueueFeeder</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/ftp/Ftp.html#setTimeout(int)">setTimeout(int)</a></span> - Method in class org.apache.nutch.protocol.ftp.<a href="org/apache/nutch/protocol/ftp/Ftp.html" title="class in org.apache.nutch.protocol.ftp">Ftp</a></dt>
<dd>
<div class="block">Set the timeout.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/CommandRunner.html#setTimeout(int)">setTimeout(int)</a></span> - Method in class org.apache.nutch.util.<a href="org/apache/nutch/util/CommandRunner.html" title="class in org.apache.nutch.util">CommandRunner</a></dt>
<dd> </dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/fetcher/FetchItemQueues.html#setTimeoutReached()">setTimeoutReached()</a></span> - Method in class org.apache.nutch.fetcher.<a href="org/apache/nutch/fetcher/FetchItemQueues.html" title="class in org.apache.nutch.fetcher">FetchItemQueues</a></dt>
+<dd>
+<div class="block">Signal that the hard timeout is reached because new fetches / requests
+ where made during half of the MapReduce task timeout
+ (<code>mapreduce.task.timeout</code>, default value: 10 minutes).</div>
+</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/webgraph/LinkDatum.html#setTimestamp(long)">setTimestamp(long)</a></span> - Method in class org.apache.nutch.scoring.webgraph.<a href="org/apache/nutch/scoring/webgraph/LinkDatum.html" title="class in org.apache.nutch.scoring.webgraph">LinkDatum</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/fetcher/FetcherThreadEvent.html#setTimestamp(java.lang.Long)">setTimestamp(Long)</a></span> - Method in class org.apache.nutch.fetcher.<a href="org/apache/nutch/fetcher/FetcherThreadEvent.html" title="class in org.apache.nutch.fetcher">FetcherThreadEvent</a></dt>
@@ -9794,8 +9735,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/tools/arc/ArcRecordReader.html#splitStart">splitStart</a></span> - Variable in class org.apache.nutch.tools.arc.<a href="org/apache/nutch/tools/arc/ArcRecordReader.html" title="class in org.apache.nutch.tools.arc">ArcRecordReader</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#SPONSORED">SPONSORED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/similarity/util/LuceneTokenizer.TokenizerType.html#STANDARD">STANDARD</a></span> - org.apache.nutch.scoring.similarity.util.<a href="org/apache/nutch/scoring/similarity/util/LuceneTokenizer.TokenizerType.html" title="enum in org.apache.nutch.scoring.similarity.util">LuceneTokenizer.TokenizerType</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/segment/SegmentReader.SegmentReaderStats.html#start">start</a></span> - Variable in class org.apache.nutch.segment.<a href="org/apache/nutch/segment/SegmentReader.SegmentReaderStats.html" title="class in org.apache.nutch.segment">SegmentReader.SegmentReaderStats</a></dt>
@@ -9854,8 +9793,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Will be invoked until plugin start up.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#STARTUP">STARTUP</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/metadata/Nutch.html#STAT_PROGRESS">STAT_PROGRESS</a></span> - Static variable in interface org.apache.nutch.metadata.<a href="org/apache/nutch/metadata/Nutch.html" title="interface in org.apache.nutch.metadata">Nutch</a></dt>
<dd>
<div class="block">For progress of job.</div>
@@ -10033,6 +9970,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<div class="block">Record the IP address of the responding server, see property
<code>store.ip.address</code>.</div>
</dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/http/api/HttpBase.html#storeProtocolVersions">storeProtocolVersions</a></span> - Variable in class org.apache.nutch.protocol.http.api.<a href="org/apache/nutch/protocol/http/api/HttpBase.html" title="class in org.apache.nutch.protocol.http.api">HttpBase</a></dt>
+<dd>
+<div class="block">Record the HTTP and SSL/TLS protocol versions and the SSL/TLS cipher
+ suites, see property <code>store.protocol.versions</code>.</div>
+</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html#stringFields">stringFields</a></span> - Static variable in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html" title="class in org.apache.nutch.hostdb">UpdateHostDbReducer</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html#stringFieldWritables">stringFieldWritables</a></span> - Static variable in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html" title="class in org.apache.nutch.hostdb">UpdateHostDbReducer</a></dt>
@@ -10195,16 +10137,10 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><a href="org/apache/nutch/indexer/tld/TLDIndexingFilter.html" title="class in org.apache.nutch.indexer.tld"><span class="typeNameLink">TLDIndexingFilter</span></a> - Class in <a href="org/apache/nutch/indexer/tld/package-summary.html">org.apache.nutch.indexer.tld</a></dt>
<dd>
-<div class="block">Adds the top-level domain extensions to the index</div>
+<div class="block">Adds the public suffix (aka.</div>
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexer/tld/TLDIndexingFilter.html#%3Cinit%3E()">TLDIndexingFilter()</a></span> - Constructor for class org.apache.nutch.indexer.tld.<a href="org/apache/nutch/indexer/tld/TLDIndexingFilter.html" title="class in org.apache.nutch.indexer.tld">TLDIndexingFilter</a></dt>
<dd> </dd>
-<dt><a href="org/apache/nutch/scoring/tld/TLDScoringFilter.html" title="class in org.apache.nutch.scoring.tld"><span class="typeNameLink">TLDScoringFilter</span></a> - Class in <a href="org/apache/nutch/scoring/tld/package-summary.html">org.apache.nutch.scoring.tld</a></dt>
-<dd>
-<div class="block">Scoring filter to boost top-level domains (TLDs).</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/scoring/tld/TLDScoringFilter.html#%3Cinit%3E()">TLDScoringFilter()</a></span> - Constructor for class org.apache.nutch.scoring.tld.<a href="org/apache/nutch/scoring/tld/TLDScoringFilter.html" title="class in org.apache.nutch.scoring.tld">TLDScoringFilter</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/protocol/http/api/HttpBase.html#tlsCheckCertificate">tlsCheckCertificate</a></span> - Variable in class org.apache.nutch.protocol.http.api.<a href="org/apache/nutch/protocol/http/api/HttpBase.html" title="class in org.apache.nutch.protocol.http.api">HttpBase</a></dt>
<dd>
<div class="block">Whether to check TLS/SSL certificates</div>
@@ -10241,18 +10177,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/indexwriter/kafka/KafkaConstants.html#TOPIC">TOPIC</a></span> - Static variable in interface org.apache.nutch.indexwriter.kafka.<a href="org/apache/nutch/indexwriter/kafka/KafkaConstants.html" title="interface in org.apache.nutch.indexwriter.kafka">KafkaConstants</a></dt>
<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain"><span class="typeNameLink">TopLevelDomain</span></a> - Class in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
-<dd>
-<div class="block">(From wikipedia) A top-level domain (TLD) is the last part of an Internet
- domain name; that is, the letters which follow the final dot of any domain
- name.</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.html#%3Cinit%3E(java.lang.String,org.apache.nutch.util.domain.DomainSuffix.Status,float,java.lang.String)">TopLevelDomain(String, DomainSuffix.Status, float, String)</a></span> - Constructor for class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain">TopLevelDomain</a></dt>
-<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.html#%3Cinit%3E(java.lang.String,org.apache.nutch.util.domain.TopLevelDomain.Type,org.apache.nutch.util.domain.DomainSuffix.Status,float)">TopLevelDomain(String, TopLevelDomain.Type, DomainSuffix.Status, float)</a></span> - Constructor for class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.html" title="class in org.apache.nutch.util.domain">TopLevelDomain</a></dt>
-<dd> </dd>
-<dt><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain"><span class="typeNameLink">TopLevelDomain.Type</span></a> - Enum in <a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/CrawlDatum.html#toString()">toString()</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/CrawlDatum.html" title="class in org.apache.nutch.crawl">CrawlDatum</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/Generator.SelectorEntry.html#toString()">toString()</a></span> - Method in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/Generator.SelectorEntry.html" title="class in org.apache.nutch.crawl">Generator.SelectorEntry</a></dt>
@@ -10304,8 +10228,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/urlfilter/fast/FastURLFilter.Rule.html#toString()">toString()</a></span> - Method in class org.apache.nutch.urlfilter.fast.<a href="org/apache/nutch/urlfilter/fast/FastURLFilter.Rule.html" title="class in org.apache.nutch.urlfilter.fast">FastURLFilter.Rule</a></dt>
<dd> </dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.html#toString()">toString()</a></span> - Method in class org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.html" title="class in org.apache.nutch.util.domain">DomainSuffix</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/net/protocols/HttpDateFormat.html#toString(long)">toString(long)</a></span> - Static method in class org.apache.nutch.net.protocols.<a href="org/apache/nutch/net/protocols/HttpDateFormat.html" title="class in org.apache.nutch.net.protocols">HttpDateFormat</a></dt>
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/TableUtil.html#toString(java.lang.CharSequence)">toString(CharSequence)</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/TableUtil.html" title="class in org.apache.nutch.util">TableUtil</a></dt>
@@ -10393,8 +10315,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">unknown reason</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#UNSPONSORED">UNSPONSORED</a></span> - org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/util/GZIPUtils.html#unzip(byte%5B%5D)">unzip(byte[])</a></span> - Static method in class org.apache.nutch.util.<a href="org/apache/nutch/util/GZIPUtils.html" title="class in org.apache.nutch.util">GZIPUtils</a></dt>
<dd>
<div class="block">Returns an gunzipped copy of the input array.</div>
@@ -10575,6 +10495,8 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd> </dd>
<dt><span class="memberNameLink"><a href="org/apache/nutch/crawl/DeduplicationJob.html#urlKey">urlKey</a></span> - Static variable in class org.apache.nutch.crawl.<a href="org/apache/nutch/crawl/DeduplicationJob.html" title="class in org.apache.nutch.crawl">DeduplicationJob</a></dt>
<dd> </dd>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html#urlLimit">urlLimit</a></span> - Static variable in class org.apache.nutch.hostdb.<a href="org/apache/nutch/hostdb/UpdateHostDbReducer.html" title="class in org.apache.nutch.hostdb">UpdateHostDbReducer</a></dt>
+<dd> </dd>
<dt><a href="org/apache/nutch/indexer/urlmeta/URLMetaIndexingFilter.html" title="class in org.apache.nutch.indexer.urlmeta"><span class="typeNameLink">URLMetaIndexingFilter</span></a> - Class in <a href="org/apache/nutch/indexer/urlmeta/package-summary.html">org.apache.nutch.indexer.urlmeta</a></dt>
<dd>
<div class="block">This is part of the URL Meta plugin.</div>
@@ -10728,15 +10650,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<dd>
<div class="block">Returns the enum constant of this type with the specified name.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html#valueOf(java.lang.String)">valueOf(String)</a></span> - Static method in enum org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></dt>
-<dd>
-<div class="block">Returns the enum constant of this type with the specified name.</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#valueOf(java.lang.String)">valueOf(String)</a></span> - Static method in enum org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd>
-<div class="block">Returns the enum constant of this type with the specified name.</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html#valueOf(java.lang.String)">valueOf(String)</a></span> - Static method in enum org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html#valueOf(java.lang.String)">valueOf(String)</a></span> - Static method in enum org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></dt>
<dd>
<div class="block">Returns the enum constant of this type with the specified name.</div>
</dd>
@@ -10790,17 +10704,7 @@ the order they are declared.</div>
<div class="block">Returns an array containing the constants of this enum type, in
the order they are declared.</div>
</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html#values()">values()</a></span> - Static method in enum org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util.domain">DomainStatistics.MyCounter</a></dt>
-<dd>
-<div class="block">Returns an array containing the constants of this enum type, in
-the order they are declared.</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/DomainSuffix.Status.html#values()">values()</a></span> - Static method in enum org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/DomainSuffix.Status.html" title="enum in org.apache.nutch.util.domain">DomainSuffix.Status</a></dt>
-<dd>
-<div class="block">Returns an array containing the constants of this enum type, in
-the order they are declared.</div>
-</dd>
-<dt><span class="memberNameLink"><a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html#values()">values()</a></span> - Static method in enum org.apache.nutch.util.domain.<a href="org/apache/nutch/util/domain/TopLevelDomain.Type.html" title="enum in org.apache.nutch.util.domain">TopLevelDomain.Type</a></dt>
+<dt><span class="memberNameLink"><a href="org/apache/nutch/util/DomainStatistics.MyCounter.html#values()">values()</a></span> - Static method in enum org.apache.nutch.util.<a href="org/apache/nutch/util/DomainStatistics.MyCounter.html" title="enum in org.apache.nutch.util">DomainStatistics.MyCounter</a></dt>
<dd>
<div class="block">Returns an array containing the constants of this enum type, in
the order they are declared.</div>
@@ -11154,7 +11058,7 @@ the order they are declared.</div>
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/index.html b/content/documentation/javadoc/api/index.html
index 5665a14..08ba93e 100644
--- a/content/documentation/javadoc/api/index.html
+++ b/content/documentation/javadoc/api/index.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Overview (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Overview (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style">
@@ -15,20 +15,20 @@
<!--[if IE]>
<script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Overview (apache-nutch 1.20 API)";
+ parent.document.title="Overview (apache-nutch 1.21 API)";
}
}
catch(err) {
}
//-->
-var data = {"i0":4096,"i1":4096,"i2":1,"i3":1,"i4":512,"i5":1,"i6":1,"i7":1,"i8":1024,"i9":1,"i10":1024,"i11":1024,"i12":1024,"i13":1024,"i14":1024,"i15":1024,"i16":1024,"i17":1024,"i18":1024,"i19":1024,"i20":1024,"i21":1024,"i22":1024,"i23":2048,"i24":2048,"i25":2048,"i26":2048,"i27":2048,"i28":1,"i29":2048,"i30":2048,"i31":1,"i32":4096,"i33":1,"i34":1,"i35":16,"i36":16,"i37":16,"i38":16,"i39":16,"i40":16,"i41":16,"i42":16,"i43":1,"i44":64,"i45":64,"i46":128,"i47":64,"i48":64,"i49":128, [...]
+var data = {"i0":4096,"i1":4096,"i2":1,"i3":1,"i4":512,"i5":1,"i6":1,"i7":1,"i8":1024,"i9":1024,"i10":1024,"i11":1024,"i12":1024,"i13":1024,"i14":1024,"i15":1024,"i16":1024,"i17":1024,"i18":1024,"i19":1024,"i20":1024,"i21":1024,"i22":1024,"i23":2048,"i24":2048,"i25":2048,"i26":2048,"i27":2048,"i28":2048,"i29":2048,"i30":2048,"i31":1,"i32":4096,"i33":1,"i34":1,"i35":16,"i36":16,"i37":16,"i38":16,"i39":16,"i40":16,"i41":16,"i42":16,"i43":1,"i44":64,"i45":64,"i46":128,"i47":64,"i48":64,"i49 [...]
var tabs = {65535:["t0","All Packages"],1:["t1","Core"],2:["t2","Plugins API"],4:["t4","Protocol Plugins"],8:["t8","URL Filter Plugins"],16:["t16","URL Normalizer Plugins"],32:["t32","Scoring Plugins"],64:["t64","Parse Plugins"],128:["t128","Parse Filter Plugins"],256:["t256","Publisher Plugins"],512:["t512","Exchange Plugins"],1024:["t1024","Indexing Filter Plugins"],2048:["t2048","Indexer Plugins"],4096:["t4096","Misc. Plugins"]};
var altColor = "altColor";
var rowColor = "rowColor";
@@ -101,7 +101,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</header>
<main role="main">
<div class="header">
-<h1 class="title">apache-nutch 1.20 API</h1>
+<h1 class="title">apache-nutch 1.21 API</h1>
</div>
<div class="contentContainer">
<div class="block"><p>Apache Nutch is a highly extensible and scalable open source web crawler software project.</p>
@@ -631,18 +631,12 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</td>
</tr>
<tr class="rowColor" id="i79">
-<th class="colFirst" scope="row"><a href="org/apache/nutch/scoring/tld/package-summary.html">org.apache.nutch.scoring.tld</a></th>
-<td class="colLast">
-<div class="block">Top Level Domain Scoring plugin.</div>
-</td>
-</tr>
-<tr class="altColor" id="i80">
<th class="colFirst" scope="row"><a href="org/apache/nutch/scoring/urlmeta/package-summary.html">org.apache.nutch.scoring.urlmeta</a></th>
<td class="colLast">
<div class="block">URL Meta Tag Scoring Plugin</div>
</td>
</tr>
-<tr class="rowColor" id="i81">
+<tr class="altColor" id="i80">
<th class="colFirst" scope="row"><a href="org/apache/nutch/scoring/webgraph/package-summary.html">org.apache.nutch.scoring.webgraph</a></th>
<td class="colLast">
<div class="block">Scoring implementation based on link analysis
@@ -650,47 +644,47 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
see <a href="org/apache/nutch/scoring/webgraph/WebGraph.html" title="class in org.apache.nutch.scoring.webgraph"><code>WebGraph</code></a>.</div>
</td>
</tr>
-<tr class="altColor" id="i82">
+<tr class="rowColor" id="i81">
<th class="colFirst" scope="row"><a href="org/apache/nutch/segment/package-summary.html">org.apache.nutch.segment</a></th>
<td class="colLast">
<div class="block">A segment stores all data from on generate/fetch/update cycle:
fetch list, protocol status, raw content, parsed content, and extracted outgoing links.</div>
</td>
</tr>
-<tr class="rowColor" id="i83">
+<tr class="altColor" id="i82">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/package-summary.html">org.apache.nutch.service</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="altColor" id="i84">
+<tr class="rowColor" id="i83">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/impl/package-summary.html">org.apache.nutch.service.impl</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="rowColor" id="i85">
+<tr class="altColor" id="i84">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/model/request/package-summary.html">org.apache.nutch.service.model.request</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="altColor" id="i86">
+<tr class="rowColor" id="i85">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/model/response/package-summary.html">org.apache.nutch.service.model.response</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="rowColor" id="i87">
+<tr class="altColor" id="i86">
<th class="colFirst" scope="row"><a href="org/apache/nutch/service/resources/package-summary.html">org.apache.nutch.service.resources</a></th>
<td class="colLast"> </td>
</tr>
-<tr class="altColor" id="i88">
+<tr class="rowColor" id="i87">
<th class="colFirst" scope="row"><a href="org/apache/nutch/tools/package-summary.html">org.apache.nutch.tools</a></th>
<td class="colLast">
<div class="block">Miscellaneous tools.</div>
</td>
</tr>
-<tr class="rowColor" id="i89">
+<tr class="altColor" id="i88">
<th class="colFirst" scope="row"><a href="org/apache/nutch/tools/arc/package-summary.html">org.apache.nutch.tools.arc</a></th>
<td class="colLast">
<div class="block">Tools to read the
<a href="http://archive.org/web/researcher/ArcFileFormat.php">Arc file format</a>.</div>
</td>
</tr>
-<tr class="altColor" id="i90">
+<tr class="rowColor" id="i89">
<th class="colFirst" scope="row"><a href="org/apache/nutch/tools/warc/package-summary.html">org.apache.nutch.tools.warc</a></th>
<td class="colLast">
<div class="block">Tools to import / export between Nutch segments and
@@ -698,14 +692,14 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
WARC archives</a>.</div>
</td>
</tr>
-<tr class="rowColor" id="i91">
+<tr class="altColor" id="i90">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/api/package-summary.html">org.apache.nutch.urlfilter.api</a></th>
<td class="colLast">
<div class="block">Generic <a href="org/apache/nutch/net/URLFilter.html" title="interface in org.apache.nutch.net"><code>URL filter</code></a> library,
abstracting away from regular expression implementations.</div>
</td>
</tr>
-<tr class="altColor" id="i92">
+<tr class="rowColor" id="i91">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/automaton/package-summary.html">org.apache.nutch.urlfilter.automaton</a></th>
<td class="colLast">
<div class="block">URL filter plugin based on
@@ -713,71 +707,65 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
Automata for Java<sup>TM</sup>.</div>
</td>
</tr>
-<tr class="rowColor" id="i93">
+<tr class="altColor" id="i92">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/domain/package-summary.html">org.apache.nutch.urlfilter.domain</a></th>
<td class="colLast">
<div class="block">URL filter plugin to include only URLs which match an element in a given list of
domain suffixes, domain names, and/or host names.</div>
</td>
</tr>
-<tr class="altColor" id="i94">
+<tr class="rowColor" id="i93">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/domaindenylist/package-summary.html">org.apache.nutch.urlfilter.domaindenylist</a></th>
<td class="colLast">
<div class="block">URL filter plugin to exclude URLs by domain suffixes, domain names, and/or host names.</div>
</td>
</tr>
-<tr class="rowColor" id="i95">
+<tr class="altColor" id="i94">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/fast/package-summary.html">org.apache.nutch.urlfilter.fast</a></th>
<td class="colLast">
<div class="block">URL filter plugin that first does fast exact suffix matches on host/domain
names before applying regular expressions to the path component of a URL.</div>
</td>
</tr>
-<tr class="altColor" id="i96">
+<tr class="rowColor" id="i95">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/ignoreexempt/package-summary.html">org.apache.nutch.urlfilter.ignoreexempt</a></th>
<td class="colLast">
<div class="block">URL filter plugin which identifies exemptions to external urls when
when external urls are set to ignore.</div>
</td>
</tr>
-<tr class="rowColor" id="i97">
+<tr class="altColor" id="i96">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/prefix/package-summary.html">org.apache.nutch.urlfilter.prefix</a></th>
<td class="colLast">
<div class="block">URL filter plugin to include only URLs which match one of a given list of URL prefixes.</div>
</td>
</tr>
-<tr class="altColor" id="i98">
+<tr class="rowColor" id="i97">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/regex/package-summary.html">org.apache.nutch.urlfilter.regex</a></th>
<td class="colLast">
<div class="block">URL filter plugin to include and/or exclude URLs matching Java regular expressions.</div>
</td>
</tr>
-<tr class="rowColor" id="i99">
+<tr class="altColor" id="i98">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/suffix/package-summary.html">org.apache.nutch.urlfilter.suffix</a></th>
<td class="colLast">
<div class="block">URL filter plugin to either exclude or include only URLs which match
one of the given (path) suffixes.</div>
</td>
</tr>
-<tr class="altColor" id="i100">
+<tr class="rowColor" id="i99">
<th class="colFirst" scope="row"><a href="org/apache/nutch/urlfilter/validator/package-summary.html">org.apache.nutch.urlfilter.validator</a></th>
<td class="colLast">
<div class="block">URL filter plugin that validates given urls.</div>
</td>
</tr>
-<tr class="rowColor" id="i101">
+<tr class="altColor" id="i100">
<th class="colFirst" scope="row"><a href="org/apache/nutch/util/package-summary.html">org.apache.nutch.util</a></th>
<td class="colLast">
<div class="block">Miscellaneous utility classes.</div>
</td>
</tr>
-<tr class="altColor" id="i102">
-<th class="colFirst" scope="row"><a href="org/apache/nutch/util/domain/package-summary.html">org.apache.nutch.util.domain</a></th>
-<td class="colLast">
-<div class="block">Classes for domain name analysis.</div>
-</td>
-</tr>
-<tr class="rowColor" id="i103">
+<tr class="rowColor" id="i101">
<th class="colFirst" scope="row"><a href="org/creativecommons/nutch/package-summary.html">org.creativecommons.nutch</a></th>
<td class="colLast">
<div class="block">Sample plugins that parse and index Creative Commons metadata.</div>
@@ -832,7 +820,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/jquery/jquery-3.6.1.min.js b/content/documentation/javadoc/api/jquery/jquery-3.6.1.min.js
deleted file mode 100644
index 2c69bc9..0000000
--- a/content/documentation/javadoc/api/jquery/jquery-3.6.1.min.js
+++ /dev/null
@@ -1,2 +0,0 @@
-/*! jQuery v3.6.1 | (c) OpenJS Foundation and other contributors | jquery.org/license */
-!function(e,t){"use strict";"object"==typeof module&&"object"==typeof module.exports?module.exports=e.document?t(e,!0):function(e){if(!e.document)throw new Error("jQuery requires a window with a document");return t(e)}:t(e)}("undefined"!=typeof window?window:this,function(C,e){"use strict";var t=[],r=Object.getPrototypeOf,s=t.slice,g=t.flat?function(e){return t.flat.call(e)}:function(e){return t.concat.apply([],e)},u=t.push,i=t.indexOf,n={},o=n.toString,y=n.hasOwnProperty,a=y.toString,l= [...]
diff --git a/content/documentation/javadoc/api/jquery/jquery-3.7.1.min.js b/content/documentation/javadoc/api/jquery/jquery-3.7.1.min.js
new file mode 100644
index 0000000..7f37b5d
--- /dev/null
+++ b/content/documentation/javadoc/api/jquery/jquery-3.7.1.min.js
@@ -0,0 +1,2 @@
+/*! jQuery v3.7.1 | (c) OpenJS Foundation and other contributors | jquery.org/license */
+!function(e,t){"use strict";"object"==typeof module&&"object"==typeof module.exports?module.exports=e.document?t(e,!0):function(e){if(!e.document)throw new Error("jQuery requires a window with a document");return t(e)}:t(e)}("undefined"!=typeof window?window:this,function(ie,e){"use strict";var oe=[],r=Object.getPrototypeOf,ae=oe.slice,g=oe.flat?function(e){return oe.flat.call(e)}:function(e){return oe.concat.apply([],e)},s=oe.push,se=oe.indexOf,n={},i=n.toString,ue=n.hasOwnProperty,o=ue [...]
diff --git a/content/documentation/javadoc/api/legal/ADDITIONAL_LICENSE_INFO b/content/documentation/javadoc/api/legal/ADDITIONAL_LICENSE_INFO
deleted file mode 100644
index ff700cd..0000000
--- a/content/documentation/javadoc/api/legal/ADDITIONAL_LICENSE_INFO
+++ /dev/null
@@ -1,37 +0,0 @@
- ADDITIONAL INFORMATION ABOUT LICENSING
-
-Certain files distributed by Oracle America, Inc. and/or its affiliates are
-subject to the following clarification and special exception to the GPLv2,
-based on the GNU Project exception for its Classpath libraries, known as the
-GNU Classpath Exception.
-
-Note that Oracle includes multiple, independent programs in this software
-package. Some of those programs are provided under licenses deemed
-incompatible with the GPLv2 by the Free Software Foundation and others.
-For example, the package includes programs licensed under the Apache
-License, Version 2.0 and may include FreeType. Such programs are licensed
-to you under their original licenses.
-
-Oracle facilitates your further distribution of this package by adding the
-Classpath Exception to the necessary parts of its GPLv2 code, which permits
-you to use that code in combination with other independent modules not
-licensed under the GPLv2. However, note that this would not permit you to
-commingle code under an incompatible license with Oracle's GPLv2 licensed
-code by, for example, cutting and pasting such code into a file also
-containing Oracle's GPLv2 licensed code and then distributing the result.
-
-Additionally, if you were to remove the Classpath Exception from any of the
-files to which it applies and distribute the result, you would likely be
-required to license some or all of the other code in that distribution under
-the GPLv2 as well, and since the GPLv2 is incompatible with the license terms
-of some items included in the distribution by Oracle, removing the Classpath
-Exception could therefore effectively compromise your ability to further
-distribute the package.
-
-Failing to distribute notices associated with some files may also create
-unexpected legal consequences.
-
-Proceed with caution and we recommend that you obtain the advice of a lawyer
-skilled in open source matters before removing the Classpath Exception or
-making modifications to this package which may subsequently be redistributed
-and/or involve the use of third party software.
diff --git a/content/documentation/javadoc/api/legal/LICENSE b/content/documentation/javadoc/api/legal/LICENSE
deleted file mode 100644
index 8b400c7..0000000
--- a/content/documentation/javadoc/api/legal/LICENSE
+++ /dev/null
@@ -1,347 +0,0 @@
-The GNU General Public License (GPL)
-
-Version 2, June 1991
-
-Copyright (C) 1989, 1991 Free Software Foundation, Inc.
-51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
-
-Everyone is permitted to copy and distribute verbatim copies of this license
-document, but changing it is not allowed.
-
-Preamble
-
-The licenses for most software are designed to take away your freedom to share
-and change it. By contrast, the GNU General Public License is intended to
-guarantee your freedom to share and change free software--to make sure the
-software is free for all its users. This General Public License applies to
-most of the Free Software Foundation's software and to any other program whose
-authors commit to using it. (Some other Free Software Foundation software is
-covered by the GNU Library General Public License instead.) You can apply it to
-your programs, too.
-
-When we speak of free software, we are referring to freedom, not price. Our
-General Public Licenses are designed to make sure that you have the freedom to
-distribute copies of free software (and charge for this service if you wish),
-that you receive source code or can get it if you want it, that you can change
-the software or use pieces of it in new free programs; and that you know you
-can do these things.
-
-To protect your rights, we need to make restrictions that forbid anyone to deny
-you these rights or to ask you to surrender the rights. These restrictions
-translate to certain responsibilities for you if you distribute copies of the
-software, or if you modify it.
-
-For example, if you distribute copies of such a program, whether gratis or for
-a fee, you must give the recipients all the rights that you have. You must
-make sure that they, too, receive or can get the source code. And you must
-show them these terms so they know their rights.
-
-We protect your rights with two steps: (1) copyright the software, and (2)
-offer you this license which gives you legal permission to copy, distribute
-and/or modify the software.
-
-Also, for each author's protection and ours, we want to make certain that
-everyone understands that there is no warranty for this free software. If the
-software is modified by someone else and passed on, we want its recipients to
-know that what they have is not the original, so that any problems introduced
-by others will not reflect on the original authors' reputations.
-
-Finally, any free program is threatened constantly by software patents. We
-wish to avoid the danger that redistributors of a free program will
-individually obtain patent licenses, in effect making the program proprietary.
-To prevent this, we have made it clear that any patent must be licensed for
-everyone's free use or not licensed at all.
-
-The precise terms and conditions for copying, distribution and modification
-follow.
-
-TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
-
-0. This License applies to any program or other work which contains a notice
-placed by the copyright holder saying it may be distributed under the terms of
-this General Public License. The "Program", below, refers to any such program
-or work, and a "work based on the Program" means either the Program or any
-derivative work under copyright law: that is to say, a work containing the
-Program or a portion of it, either verbatim or with modifications and/or
-translated into another language. (Hereinafter, translation is included
-without limitation in the term "modification".) Each licensee is addressed as
-"you".
-
-Activities other than copying, distribution and modification are not covered by
-this License; they are outside its scope. The act of running the Program is
-not restricted, and the output from the Program is covered only if its contents
-constitute a work based on the Program (independent of having been made by
-running the Program). Whether that is true depends on what the Program does.
-
-1. You may copy and distribute verbatim copies of the Program's source code as
-you receive it, in any medium, provided that you conspicuously and
-appropriately publish on each copy an appropriate copyright notice and
-disclaimer of warranty; keep intact all the notices that refer to this License
-and to the absence of any warranty; and give any other recipients of the
-Program a copy of this License along with the Program.
-
-You may charge a fee for the physical act of transferring a copy, and you may
-at your option offer warranty protection in exchange for a fee.
-
-2. You may modify your copy or copies of the Program or any portion of it, thus
-forming a work based on the Program, and copy and distribute such modifications
-or work under the terms of Section 1 above, provided that you also meet all of
-these conditions:
-
- a) You must cause the modified files to carry prominent notices stating
- that you changed the files and the date of any change.
-
- b) You must cause any work that you distribute or publish, that in whole or
- in part contains or is derived from the Program or any part thereof, to be
- licensed as a whole at no charge to all third parties under the terms of
- this License.
-
- c) If the modified program normally reads commands interactively when run,
- you must cause it, when started running for such interactive use in the
- most ordinary way, to print or display an announcement including an
- appropriate copyright notice and a notice that there is no warranty (or
- else, saying that you provide a warranty) and that users may redistribute
- the program under these conditions, and telling the user how to view a copy
- of this License. (Exception: if the Program itself is interactive but does
- not normally print such an announcement, your work based on the Program is
- not required to print an announcement.)
-
-These requirements apply to the modified work as a whole. If identifiable
-sections of that work are not derived from the Program, and can be reasonably
-considered independent and separate works in themselves, then this License, and
-its terms, do not apply to those sections when you distribute them as separate
-works. But when you distribute the same sections as part of a whole which is a
-work based on the Program, the distribution of the whole must be on the terms
-of this License, whose permissions for other licensees extend to the entire
-whole, and thus to each and every part regardless of who wrote it.
-
-Thus, it is not the intent of this section to claim rights or contest your
-rights to work written entirely by you; rather, the intent is to exercise the
-right to control the distribution of derivative or collective works based on
-the Program.
-
-In addition, mere aggregation of another work not based on the Program with the
-Program (or with a work based on the Program) on a volume of a storage or
-distribution medium does not bring the other work under the scope of this
-License.
-
-3. You may copy and distribute the Program (or a work based on it, under
-Section 2) in object code or executable form under the terms of Sections 1 and
-2 above provided that you also do one of the following:
-
- a) Accompany it with the complete corresponding machine-readable source
- code, which must be distributed under the terms of Sections 1 and 2 above
- on a medium customarily used for software interchange; or,
-
- b) Accompany it with a written offer, valid for at least three years, to
- give any third party, for a charge no more than your cost of physically
- performing source distribution, a complete machine-readable copy of the
- corresponding source code, to be distributed under the terms of Sections 1
- and 2 above on a medium customarily used for software interchange; or,
-
- c) Accompany it with the information you received as to the offer to
- distribute corresponding source code. (This alternative is allowed only
- for noncommercial distribution and only if you received the program in
- object code or executable form with such an offer, in accord with
- Subsection b above.)
-
-The source code for a work means the preferred form of the work for making
-modifications to it. For an executable work, complete source code means all
-the source code for all modules it contains, plus any associated interface
-definition files, plus the scripts used to control compilation and installation
-of the executable. However, as a special exception, the source code
-distributed need not include anything that is normally distributed (in either
-source or binary form) with the major components (compiler, kernel, and so on)
-of the operating system on which the executable runs, unless that component
-itself accompanies the executable.
-
-If distribution of executable or object code is made by offering access to copy
-from a designated place, then offering equivalent access to copy the source
-code from the same place counts as distribution of the source code, even though
-third parties are not compelled to copy the source along with the object code.
-
-4. You may not copy, modify, sublicense, or distribute the Program except as
-expressly provided under this License. Any attempt otherwise to copy, modify,
-sublicense or distribute the Program is void, and will automatically terminate
-your rights under this License. However, parties who have received copies, or
-rights, from you under this License will not have their licenses terminated so
-long as such parties remain in full compliance.
-
-5. You are not required to accept this License, since you have not signed it.
-However, nothing else grants you permission to modify or distribute the Program
-or its derivative works. These actions are prohibited by law if you do not
-accept this License. Therefore, by modifying or distributing the Program (or
-any work based on the Program), you indicate your acceptance of this License to
-do so, and all its terms and conditions for copying, distributing or modifying
-the Program or works based on it.
-
-6. Each time you redistribute the Program (or any work based on the Program),
-the recipient automatically receives a license from the original licensor to
-copy, distribute or modify the Program subject to these terms and conditions.
-You may not impose any further restrictions on the recipients' exercise of the
-rights granted herein. You are not responsible for enforcing compliance by
-third parties to this License.
-
-7. If, as a consequence of a court judgment or allegation of patent
-infringement or for any other reason (not limited to patent issues), conditions
-are imposed on you (whether by court order, agreement or otherwise) that
-contradict the conditions of this License, they do not excuse you from the
-conditions of this License. If you cannot distribute so as to satisfy
-simultaneously your obligations under this License and any other pertinent
-obligations, then as a consequence you may not distribute the Program at all.
-For example, if a patent license would not permit royalty-free redistribution
-of the Program by all those who receive copies directly or indirectly through
-you, then the only way you could satisfy both it and this License would be to
-refrain entirely from distribution of the Program.
-
-If any portion of this section is held invalid or unenforceable under any
-particular circumstance, the balance of the section is intended to apply and
-the section as a whole is intended to apply in other circumstances.
-
-It is not the purpose of this section to induce you to infringe any patents or
-other property right claims or to contest validity of any such claims; this
-section has the sole purpose of protecting the integrity of the free software
-distribution system, which is implemented by public license practices. Many
-people have made generous contributions to the wide range of software
-distributed through that system in reliance on consistent application of that
-system; it is up to the author/donor to decide if he or she is willing to
-distribute software through any other system and a licensee cannot impose that
-choice.
-
-This section is intended to make thoroughly clear what is believed to be a
-consequence of the rest of this License.
-
-8. If the distribution and/or use of the Program is restricted in certain
-countries either by patents or by copyrighted interfaces, the original
-copyright holder who places the Program under this License may add an explicit
-geographical distribution limitation excluding those countries, so that
-distribution is permitted only in or among countries not thus excluded. In
-such case, this License incorporates the limitation as if written in the body
-of this License.
-
-9. The Free Software Foundation may publish revised and/or new versions of the
-General Public License from time to time. Such new versions will be similar in
-spirit to the present version, but may differ in detail to address new problems
-or concerns.
-
-Each version is given a distinguishing version number. If the Program
-specifies a version number of this License which applies to it and "any later
-version", you have the option of following the terms and conditions either of
-that version or of any later version published by the Free Software Foundation.
-If the Program does not specify a version number of this License, you may
-choose any version ever published by the Free Software Foundation.
-
-10. If you wish to incorporate parts of the Program into other free programs
-whose distribution conditions are different, write to the author to ask for
-permission. For software which is copyrighted by the Free Software Foundation,
-write to the Free Software Foundation; we sometimes make exceptions for this.
-Our decision will be guided by the two goals of preserving the free status of
-all derivatives of our free software and of promoting the sharing and reuse of
-software generally.
-
-NO WARRANTY
-
-11. BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR
-THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE
-STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE
-PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED,
-INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND
-FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND
-PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE,
-YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
-
-12. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL
-ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE
-PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
-GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR
-INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA
-BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A
-FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH HOLDER
-OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
-
-END OF TERMS AND CONDITIONS
-
-How to Apply These Terms to Your New Programs
-
-If you develop a new program, and you want it to be of the greatest possible
-use to the public, the best way to achieve this is to make it free software
-which everyone can redistribute and change under these terms.
-
-To do so, attach the following notices to the program. It is safest to attach
-them to the start of each source file to most effectively convey the exclusion
-of warranty; and each file should have at least the "copyright" line and a
-pointer to where the full notice is found.
-
- One line to give the program's name and a brief idea of what it does.
-
- Copyright (C) <year> <name of author>
-
- This program is free software; you can redistribute it and/or modify it
- under the terms of the GNU General Public License as published by the Free
- Software Foundation; either version 2 of the License, or (at your option)
- any later version.
-
- This program is distributed in the hope that it will be useful, but WITHOUT
- ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
- FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for
- more details.
-
- You should have received a copy of the GNU General Public License along
- with this program; if not, write to the Free Software Foundation, Inc.,
- 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
-
-Also add information on how to contact you by electronic and paper mail.
-
-If the program is interactive, make it output a short notice like this when it
-starts in an interactive mode:
-
- Gnomovision version 69, Copyright (C) year name of author Gnomovision comes
- with ABSOLUTELY NO WARRANTY; for details type 'show w'. This is free
- software, and you are welcome to redistribute it under certain conditions;
- type 'show c' for details.
-
-The hypothetical commands 'show w' and 'show c' should show the appropriate
-parts of the General Public License. Of course, the commands you use may be
-called something other than 'show w' and 'show c'; they could even be
-mouse-clicks or menu items--whatever suits your program.
-
-You should also get your employer (if you work as a programmer) or your school,
-if any, to sign a "copyright disclaimer" for the program, if necessary. Here
-is a sample; alter the names:
-
- Yoyodyne, Inc., hereby disclaims all copyright interest in the program
- 'Gnomovision' (which makes passes at compilers) written by James Hacker.
-
- signature of Ty Coon, 1 April 1989
-
- Ty Coon, President of Vice
-
-This General Public License does not permit incorporating your program into
-proprietary programs. If your program is a subroutine library, you may
-consider it more useful to permit linking proprietary applications with the
-library. If this is what you want to do, use the GNU Library General Public
-License instead of this License.
-
-
-"CLASSPATH" EXCEPTION TO THE GPL
-
-Certain source files distributed by Oracle America and/or its affiliates are
-subject to the following clarification and special exception to the GPL, but
-only where Oracle has expressly included in the particular source file's header
-the words "Oracle designates this particular file as subject to the "Classpath"
-exception as provided by Oracle in the LICENSE file that accompanied this code."
-
- Linking this library statically or dynamically with other modules is making
- a combined work based on this library. Thus, the terms and conditions of
- the GNU General Public License cover the whole combination.
-
- As a special exception, the copyright holders of this library give you
- permission to link this library with independent modules to produce an
- executable, regardless of the license terms of these independent modules,
- and to copy and distribute the resulting executable under terms of your
- choice, provided that you also meet, for each linked independent module,
- the terms and conditions of the license of that module. An independent
- module is a module which is not derived from or based on this library. If
- you modify this library, you may extend this exception to your version of
- the library, but you are not obligated to do so. If you do not wish to do
- so, delete this exception statement from your version.
diff --git a/content/documentation/javadoc/api/legal/jquery.md b/content/documentation/javadoc/api/legal/jquery.md
index d468b31..a763ec6 100644
--- a/content/documentation/javadoc/api/legal/jquery.md
+++ b/content/documentation/javadoc/api/legal/jquery.md
@@ -1,8 +1,8 @@
-## jQuery v3.6.1
+## jQuery v3.7.1
### jQuery License
```
-jQuery v 3.6.1
+jQuery v 3.7.1
Copyright OpenJS Foundation and other contributors, https://openjsf.org/
Permission is hereby granted, free of charge, to any person obtaining
@@ -23,50 +23,4 @@ NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
-
-******************************************
-
-The jQuery JavaScript Library v3.6.1 also includes Sizzle.js
-
-Sizzle.js includes the following license:
-
-Copyright JS Foundation and other contributors, https://js.foundation/
-
-This software consists of voluntary contributions made by many
-individuals. For exact contribution history, see the revision history
-available at https://github.com/jquery/sizzle
-
-The following license applies to all parts of this software except as
-documented below:
-
-====
-
-Permission is hereby granted, free of charge, to any person obtaining
-a copy of this software and associated documentation files (the
-"Software"), to deal in the Software without restriction, including
-without limitation the rights to use, copy, modify, merge, publish,
-distribute, sublicense, and/or sell copies of the Software, and to
-permit persons to whom the Software is furnished to do so, subject to
-the following conditions:
-
-The above copyright notice and this permission notice shall be
-included in all copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
-EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
-MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
-NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
-LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
-OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
-WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
-
-====
-
-All files located in the node_modules and external directories are
-externally maintained libraries used by this software which have their
-own licenses; we recommend you read them, as their terms may differ from
-the terms above.
-
-*********************
-
```
diff --git a/content/documentation/javadoc/api/member-search-index.js b/content/documentation/javadoc/api/member-search-index.js
index 86aa2db..4d7d104 100644
--- a/content/documentation/javadoc/api/member-search-index.js
+++ b/content/documentation/javadoc/api/member-search-index.js
@@ -1 +1 @@
-memberSearchIndex = [{"p":"org.apache.nutch.protocol.ftp","c":"Client","l":"__openPassiveDataConnection(int, String)","url":"__openPassiveDataConnection(int,java.lang.String)"},{"p":"org.apache.nutch.crawl","c":"SignatureComparator","l":"_compare(byte[], int, int, byte[], int, int)","url":"_compare(byte[],int,int,byte[],int,int)"},{"p":"org.apache.nutch.crawl","c":"SignatureComparator","l":"_compare(Object, Object)","url":"_compare(java.lang.Object,java.lang.Object)"},{"p":"org.apache.nu [...]
\ No newline at end of file
+memberSearchIndex = [{"p":"org.apache.nutch.protocol.ftp","c":"Client","l":"__openPassiveDataConnection(int, String)","url":"__openPassiveDataConnection(int,java.lang.String)"},{"p":"org.apache.nutch.crawl","c":"SignatureComparator","l":"_compare(byte[], int, int, byte[], int, int)","url":"_compare(byte[],int,int,byte[],int,int)"},{"p":"org.apache.nutch.crawl","c":"SignatureComparator","l":"_compare(Object, Object)","url":"_compare(java.lang.Object,java.lang.Object)"},{"p":"org.apache.nu [...]
\ No newline at end of file
diff --git a/content/documentation/javadoc/api/member-search-index.zip b/content/documentation/javadoc/api/member-search-index.zip
index c0710e4..043bc46 100644
Binary files a/content/documentation/javadoc/api/member-search-index.zip and b/content/documentation/javadoc/api/member-search-index.zip differ
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/HTMLLanguageParser.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/HTMLLanguageParser.html
index e6063ed..09fa3b5 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/HTMLLanguageParser.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/HTMLLanguageParser.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>HTMLLanguageParser (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>HTMLLanguageParser (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="HTMLLanguageParser (apache-nutch 1.20 API)";
+ parent.document.title="HTMLLanguageParser (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -393,7 +393,7 @@ implements <a href="../../parse/HtmlParseFilter.html" title="interface in org.ap
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/LanguageIndexingFilter.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/LanguageIndexingFilter.html
index fc207e0..908e5f6 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/LanguageIndexingFilter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/LanguageIndexingFilter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LanguageIndexingFilter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LanguageIndexingFilter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LanguageIndexingFilter (apache-nutch 1.20 API)";
+ parent.document.title="LanguageIndexingFilter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -410,7 +410,7 @@ implements <a href="../../indexer/IndexingFilter.html" title="interface in org.a
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/HTMLLanguageParser.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/HTMLLanguageParser.html
index f462283..03ea1c0 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/HTMLLanguageParser.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/HTMLLanguageParser.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.analysis.lang.HTMLLanguageParser (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.analysis.lang.HTMLLanguageParser (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.analysis.lang.HTMLLanguageParser (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.analysis.lang.HTMLLanguageParser (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -144,7 +144,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/LanguageIndexingFilter.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/LanguageIndexingFilter.html
index 6accd01..c4efc48 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/LanguageIndexingFilter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/class-use/LanguageIndexingFilter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.analysis.lang.LanguageIndexingFilter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.analysis.lang.LanguageIndexingFilter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.analysis.lang.LanguageIndexingFilter (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.analysis.lang.LanguageIndexingFilter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -144,7 +144,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-summary.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-summary.html
index a102f2a..bb456eb 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-summary.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-summary.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>org.apache.nutch.analysis.lang (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>org.apache.nutch.analysis.lang (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="org.apache.nutch.analysis.lang (apache-nutch 1.20 API)";
+ parent.document.title="org.apache.nutch.analysis.lang (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -177,7 +177,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-tree.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-tree.html
index fb229f7..9c4223f 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-tree.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-tree.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>org.apache.nutch.analysis.lang Class Hierarchy (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>org.apache.nutch.analysis.lang Class Hierarchy (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="org.apache.nutch.analysis.lang Class Hierarchy (apache-nutch 1.20 API)";
+ parent.document.title="org.apache.nutch.analysis.lang Class Hierarchy (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -160,7 +160,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-use.html b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-use.html
index 692d340..5c4930c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-use.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/analysis/lang/package-use.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Package org.apache.nutch.analysis.lang (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Package org.apache.nutch.analysis.lang (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Package org.apache.nutch.analysis.lang (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Package org.apache.nutch.analysis.lang (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -144,7 +144,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/CollectionManager.html b/content/documentation/javadoc/api/org/apache/nutch/collection/CollectionManager.html
index 15689ad..cd5702e 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/CollectionManager.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/CollectionManager.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CollectionManager (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CollectionManager (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CollectionManager (apache-nutch 1.20 API)";
+ parent.document.title="CollectionManager (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -233,7 +233,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/con
</td>
</tr>
<tr id="i2" class="altColor">
-<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/Collection.html?is-external=true" title="class or interface in java.util" class="externalLink">Collection</a></code></td>
+<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/Collection.html?is-external=true" title="class or interface in java.util" class="externalLink">Collection</a><<a href="Subcollection.html" title="class in org.apache.nutch.collection">Subcollection</a>></code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getAll()">getAll</a></span>()</code></th>
<td class="colLast">
<div class="block">Returns all collections</div>
@@ -459,7 +459,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/con
<ul class="blockList">
<li class="blockList">
<h4>getAll</h4>
-<pre class="methodSignature">public <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/Collection.html?is-external=true" title="class or interface in java.util" class="externalLink">Collection</a> getAll()</pre>
+<pre class="methodSignature">public <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/Collection.html?is-external=true" title="class or interface in java.util" class="externalLink">Collection</a><<a href="Subcollection.html" title="class in org.apache.nutch.collection">Subcollection</a>> getAll()</pre>
<div class="block">Returns all collections</div>
<dl>
<dt><span class="returnLabel">Returns:</span></dt>
@@ -553,7 +553,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/con
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/Subcollection.html b/content/documentation/javadoc/api/org/apache/nutch/collection/Subcollection.html
index 2209732..d1395d0 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/Subcollection.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/Subcollection.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Subcollection (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Subcollection (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Subcollection (apache-nutch 1.20 API)";
+ parent.document.title="Subcollection (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -790,7 +790,7 @@ implements <a href="../net/URLFilter.html" title="interface in org.apache.nutch.
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/CollectionManager.html b/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/CollectionManager.html
index 5cf6568..3956065 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/CollectionManager.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/CollectionManager.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.collection.CollectionManager (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.collection.CollectionManager (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.collection.CollectionManager (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.collection.CollectionManager (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -190,7 +190,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/Subcollection.html b/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/Subcollection.html
index 28bed80..5e2758b 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/Subcollection.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/class-use/Subcollection.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.collection.Subcollection (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.collection.Subcollection (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.collection.Subcollection (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.collection.Subcollection (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -157,6 +157,13 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</tr>
<tbody>
<tr class="altColor">
+<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/Collection.html?is-external=true" title="class or interface in java.util" class="externalLink">Collection</a><<a href="../Subcollection.html" title="class in org.apache.nutch.collection">Subcollection</a>></code></td>
+<th class="colSecond" scope="row"><span class="typeNameLabel">CollectionManager.</span><code><span class="memberNameLink"><a href="../CollectionManager.html#getAll()">getAll</a></span>()</code></th>
+<td class="colLast">
+<div class="block">Returns all collections</div>
+</td>
+</tr>
+<tr class="rowColor">
<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util/List.html?is-external=true" title="class or interface in java.util" class="externalLink">List</a><<a href="../Subcollection.html" title="class in org.apache.nutch.collection">Subcollection</a>></code></td>
<th class="colSecond" scope="row"><span class="typeNameLabel">CollectionManager.</span><code><span class="memberNameLink"><a href="../CollectionManager.html#getSubCollections(java.lang.String)">getSubCollections</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a> url)</code></th>
<td class="colLast">
@@ -217,7 +224,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/package-summary.html b/content/documentation/javadoc/api/org/apache/nutch/collection/package-summary.html
index cc46b22..0a0709c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/package-summary.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/package-summary.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>org.apache.nutch.collection (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>org.apache.nutch.collection (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="org.apache.nutch.collection (apache-nutch 1.20 API)";
+ parent.document.title="org.apache.nutch.collection (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -202,7 +202,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/package-tree.html b/content/documentation/javadoc/api/org/apache/nutch/collection/package-tree.html
index 8869951..731b6bf 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/package-tree.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/package-tree.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>org.apache.nutch.collection Class Hierarchy (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>org.apache.nutch.collection Class Hierarchy (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="org.apache.nutch.collection Class Hierarchy (apache-nutch 1.20 API)";
+ parent.document.title="org.apache.nutch.collection Class Hierarchy (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -164,7 +164,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/collection/package-use.html b/content/documentation/javadoc/api/org/apache/nutch/collection/package-use.html
index 168eb8e..2fa2cfa 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/collection/package-use.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/collection/package-use.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Package org.apache.nutch.collection (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Package org.apache.nutch.collection (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Package org.apache.nutch.collection (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Package org.apache.nutch.collection (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -188,7 +188,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/AbstractFetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/AbstractFetchSchedule.html
index b443809..10e073b 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/AbstractFetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/AbstractFetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>AbstractFetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>AbstractFetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="AbstractFetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="AbstractFetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -704,7 +704,7 @@ implements <a href="FetchSchedule.html" title="interface in org.apache.nutch.cra
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/AdaptiveFetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/AdaptiveFetchSchedule.html
index 944116b..eef83aa 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/AdaptiveFetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/AdaptiveFetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>AdaptiveFetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>AdaptiveFetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,20 +15,20 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="AdaptiveFetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="AdaptiveFetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
}
//-->
-var data = {"i0":9,"i1":10,"i2":10,"i3":9,"i4":10,"i5":10};
+var data = {"i0":10,"i1":10,"i2":9,"i3":9,"i4":10,"i5":10};
var tabs = {65535:["t0","All Methods"],1:["t1","Static Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
var altColor = "altColor";
var rowColor = "rowColor";
@@ -181,7 +181,13 @@ extends <a href="AbstractFetchSchedule.html" title="class in org.apache.nutch.cr
infinitely, with little relevance to the page changes. Please use
<a href="#main(java.lang.String%5B%5D)"><code>main(String[])</code></a> method to test the values before applying them in a
production system.
- </p></div>
+ </p>
+
+ The class also allows specifying custom min. and max. re-fetch intervals per
+ hostname, in adaptive-host-specific-intervals.txt. If they are specified,
+ the calculated re-fetch interval for a URL matching the hostname will not be
+ allowed to fall outside of the corresponding range, instead of the default
+ range.</div>
<dl>
<dt><span class="simpleTagLabel">Author:</span></dt>
<dd>Andrzej Bialecki</dd>
@@ -270,26 +276,24 @@ extends <a href="AbstractFetchSchedule.html" title="class in org.apache.nutch.cr
<th class="colLast" scope="col">Description</th>
</tr>
<tr id="i0" class="altColor">
-<td class="colFirst"><code>static <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
-<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getHostName(java.lang.String)">getHostName</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a> url)</code></th>
+<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Float.html?is-external=true" title="class or interface in java.lang" class="externalLink">Float</a></code></td>
+<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getCustomMaxInterval(org.apache.hadoop.io.Text)">getCustomMaxInterval</a></span>​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url)</code></th>
<td class="colLast">
-<div class="block">Strip a URL, leaving only the host name.</div>
+<div class="block">Returns the custom max.</div>
</td>
</tr>
<tr id="i1" class="rowColor">
-<td class="colFirst"><code>float</code></td>
-<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getMaxInterval(org.apache.hadoop.io.Text,float)">getMaxInterval</a></span>​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url,
- float defaultMaxInterval)</code></th>
+<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Float.html?is-external=true" title="class or interface in java.lang" class="externalLink">Float</a></code></td>
+<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getCustomMinInterval(org.apache.hadoop.io.Text)">getCustomMinInterval</a></span>​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url)</code></th>
<td class="colLast">
-<div class="block">Returns the max_interval for this URL, which might depend on the host.</div>
+<div class="block">Returns the custom min.</div>
</td>
</tr>
<tr id="i2" class="altColor">
-<td class="colFirst"><code>float</code></td>
-<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getMinInterval(org.apache.hadoop.io.Text,float)">getMinInterval</a></span>​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url,
- float defaultMinInterval)</code></th>
+<td class="colFirst"><code>static <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
+<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getHostName(java.lang.String)">getHostName</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a> url)</code></th>
<td class="colLast">
-<div class="block">Returns the min_interval for this URL, which might depend on the host.</div>
+<div class="block">Strip a URL, leaving only the hostname.</div>
</td>
</tr>
<tr id="i3" class="rowColor">
@@ -431,10 +435,10 @@ extends <a href="AbstractFetchSchedule.html" title="class in org.apache.nutch.cr
<h4>getHostName</h4>
<pre class="methodSignature">public static <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a> getHostName​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a> url)
throws <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/net/URISyntaxException.html?is-external=true" title="class or interface in java.net" class="externalLink">URISyntaxException</a></pre>
-<div class="block">Strip a URL, leaving only the host name.</div>
+<div class="block">Strip a URL, leaving only the hostname.</div>
<dl>
<dt><span class="paramLabel">Parameters:</span></dt>
-<dd><code>url</code> - url to get hostname for</dd>
+<dd><code>url</code> - the URL for which to get the hostname</dd>
<dt><span class="returnLabel">Returns:</span></dt>
<dd>hostname</dd>
<dt><span class="throwsLabel">Throws:</span></dt>
@@ -442,39 +446,37 @@ extends <a href="AbstractFetchSchedule.html" title="class in org.apache.nutch.cr
</dl>
</li>
</ul>
-<a id="getMaxInterval(org.apache.hadoop.io.Text,float)">
+<a id="getCustomMaxInterval(org.apache.hadoop.io.Text)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
-<h4>getMaxInterval</h4>
-<pre class="methodSignature">public float getMaxInterval​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url,
- float defaultMaxInterval)</pre>
-<div class="block">Returns the max_interval for this URL, which might depend on the host.</div>
+<h4>getCustomMaxInterval</h4>
+<pre class="methodSignature">public <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Float.html?is-external=true" title="class or interface in java.lang" class="externalLink">Float</a> getCustomMaxInterval​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url)</pre>
+<div class="block">Returns the custom max. refetch interval for this URL,
+ if specified for the corresponding hostname.</div>
<dl>
<dt><span class="paramLabel">Parameters:</span></dt>
<dd><code>url</code> - the URL to be scheduled</dd>
-<dd><code>defaultMaxInterval</code> - the value to which to default if max_interval has not been configured for this host</dd>
<dt><span class="returnLabel">Returns:</span></dt>
-<dd>the configured maximum interval or the default interval</dd>
+<dd>the configured max. interval or null</dd>
</dl>
</li>
</ul>
-<a id="getMinInterval(org.apache.hadoop.io.Text,float)">
+<a id="getCustomMinInterval(org.apache.hadoop.io.Text)">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
-<h4>getMinInterval</h4>
-<pre class="methodSignature">public float getMinInterval​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url,
- float defaultMinInterval)</pre>
-<div class="block">Returns the min_interval for this URL, which might depend on the host.</div>
+<h4>getCustomMinInterval</h4>
+<pre class="methodSignature">public <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Float.html?is-external=true" title="class or interface in java.lang" class="externalLink">Float</a> getCustomMinInterval​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">Text</a> url)</pre>
+<div class="block">Returns the custom min. refetch interval for this URL,
+ if specified for the corresponding hostname.</div>
<dl>
<dt><span class="paramLabel">Parameters:</span></dt>
<dd><code>url</code> - the URL to be scheduled</dd>
-<dd><code>defaultMinInterval</code> - the value to which to default if min_interval has not been configured for this host</dd>
<dt><span class="returnLabel">Returns:</span></dt>
-<dd>the configured minimum interval or the default interval</dd>
+<dd>the configured min. interval or null</dd>
</dl>
</li>
</ul>
@@ -613,7 +615,7 @@ extends <a href="AbstractFetchSchedule.html" title="class in org.apache.nutch.cr
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.Comparator.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.Comparator.html
index a6170e4..8821e4f 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.Comparator.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.Comparator.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDatum.Comparator (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDatum.Comparator (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDatum.Comparator (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDatum.Comparator (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -346,7 +346,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.html
index 9b6d2df..23c80cd 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDatum.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDatum (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDatum (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDatum (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDatum (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -1408,7 +1408,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDb.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDb.html
index 86a28f9..2e1fc0a 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDb.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDb.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDb (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDb (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDb (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDb (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -664,7 +664,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbFilter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbFilter.html
index f73474b..158528b 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbFilter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbFilter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbFilter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbFilter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbFilter (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbFilter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -450,7 +450,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.Merger.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.Merger.html
index 8852c07..71d9bf8 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.Merger.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.Merger.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbMerger.Merger (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbMerger.Merger (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbMerger.Merger (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbMerger.Merger (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.html
index 7944483..221d53b 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbMerger.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbMerger (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbMerger (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbMerger (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbMerger (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -460,7 +460,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter.html
index de0f9dd..5060eb8 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -341,7 +341,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.html
index 79e8207..8df654b 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumCsvOutputFormat.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDatumCsvOutputFormat (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDatumCsvOutputFormat (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDatumCsvOutputFormat (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDatumCsvOutputFormat (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -377,7 +377,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter.html
index fd16e25..88c6aab 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDatumJsonOutputFormat.LineRecordWriter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -341,7 +341,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer.html
index a1efda3..be5cd8c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDatumJsonOutputFormat.WritableSerializer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -350,7 +350,7 @@ extends com.fasterxml.jackson.databind.JsonSerializer<<a href="https://hadoop
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.html
index c97de41..90c136a 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDatumJsonOutputFormat.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDatumJsonOutputFormat (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDatumJsonOutputFormat (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDatumJsonOutputFormat (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDatumJsonOutputFormat (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -382,7 +382,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbDumpMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbDumpMapper.html
index a8dabf5..bc7f403 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbDumpMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbDumpMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDbDumpMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDbDumpMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDbDumpMapper (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDbDumpMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatMapper.html
index d380137..e4fdef3 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDbStatMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDbStatMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDbStatMapper (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDbStatMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatReducer.html
index e390442..a25c568 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbStatReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDbStatReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDbStatReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDbStatReducer (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDbStatReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNMapper.html
index d005e38..6df531c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDbTopNMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDbTopNMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDbTopNMapper (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDbTopNMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNReducer.html
index c71dc81..1fe809d 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.CrawlDbTopNReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.CrawlDbTopNReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.CrawlDbTopNReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.CrawlDbTopNReducer (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.CrawlDbTopNReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.JsonIndenter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.JsonIndenter.html
index 837a09c..ddc8da2 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.JsonIndenter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.JsonIndenter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader.JsonIndenter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader.JsonIndenter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader.JsonIndenter (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader.JsonIndenter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -386,7 +386,7 @@ extends com.fasterxml.jackson.core.util.MinimalPrettyPrinter</pre>
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.html
index f4835ce..e701c44 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReader.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReader (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReader (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReader (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReader (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -695,7 +695,7 @@ implements <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/C
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReducer.html
index b696256..3c80f1a 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/CrawlDbReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>CrawlDbReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>CrawlDbReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="CrawlDbReducer (apache-nutch 1.20 API)";
+ parent.document.title="CrawlDbReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -363,7 +363,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DBFilter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DBFilter.html
index 9d776cd..562a361 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DBFilter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DBFilter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>DeduplicationJob.DBFilter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>DeduplicationJob.DBFilter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="DeduplicationJob.DBFilter (apache-nutch 1.20 API)";
+ parent.document.title="DeduplicationJob.DBFilter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DedupReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DedupReducer.html
index 816973a..14c620c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DedupReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.DedupReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>DeduplicationJob.DedupReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>DeduplicationJob.DedupReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="DeduplicationJob.DedupReducer (apache-nutch 1.20 API)";
+ parent.document.title="DeduplicationJob.DedupReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -449,7 +449,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.StatusUpdateReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.StatusUpdateReducer.html
index 9f4b4ca..373f67e 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.StatusUpdateReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.StatusUpdateReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>DeduplicationJob.StatusUpdateReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>DeduplicationJob.StatusUpdateReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="DeduplicationJob.StatusUpdateReducer (apache-nutch 1.20 API)";
+ parent.document.title="DeduplicationJob.StatusUpdateReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -367,7 +367,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.html
index be43af8..51b1896 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/DeduplicationJob.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>DeduplicationJob (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>DeduplicationJob (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="DeduplicationJob (apache-nutch 1.20 API)";
+ parent.document.title="DeduplicationJob (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -538,7 +538,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/DefaultFetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/DefaultFetchSchedule.html
index 2018a50..44fa150 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/DefaultFetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/DefaultFetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>DefaultFetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>DefaultFetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="DefaultFetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="DefaultFetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -421,7 +421,7 @@ extends <a href="AbstractFetchSchedule.html" title="class in org.apache.nutch.cr
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchSchedule.html
index 9c35c29..0be7687 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>FetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>FetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="FetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="FetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -635,7 +635,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/con
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchScheduleFactory.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchScheduleFactory.html
index 28584dd..1ed9d57 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchScheduleFactory.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/FetchScheduleFactory.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>FetchScheduleFactory (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>FetchScheduleFactory (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="FetchScheduleFactory (apache-nutch 1.20 API)";
+ parent.document.title="FetchScheduleFactory (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -276,7 +276,7 @@ extends <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Ob
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateMapper.html
index a2a45d9..416317f 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.CrawlDbUpdater.CrawlDbUpdateMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.CrawlDbUpdater.CrawlDbUpdateMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.CrawlDbUpdater.CrawlDbUpdateMapper (apache-nutch 1.20 API)";
+ parent.document.title="Generator.CrawlDbUpdater.CrawlDbUpdateMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -348,7 +348,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateReducer.html
index 239e4f7..d09ad07 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.CrawlDbUpdateReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.CrawlDbUpdater.CrawlDbUpdateReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.CrawlDbUpdater.CrawlDbUpdateReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.CrawlDbUpdater.CrawlDbUpdateReducer (apache-nutch 1.20 API)";
+ parent.document.title="Generator.CrawlDbUpdater.CrawlDbUpdateReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.html
index f65be18..8ac8c64 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.CrawlDbUpdater.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.CrawlDbUpdater (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.CrawlDbUpdater (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.CrawlDbUpdater (apache-nutch 1.20 API)";
+ parent.document.title="Generator.CrawlDbUpdater (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -297,7 +297,7 @@ extends <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Ob
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.DecreasingFloatComparator.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.DecreasingFloatComparator.html
index edd090a..39336ee 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.DecreasingFloatComparator.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.DecreasingFloatComparator.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.DecreasingFloatComparator (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.DecreasingFloatComparator (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.DecreasingFloatComparator (apache-nutch 1.20 API)";
+ parent.document.title="Generator.DecreasingFloatComparator (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -353,7 +353,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.HashComparator.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.HashComparator.html
index 1d99508..5b2ff84 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.HashComparator.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.HashComparator.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.HashComparator (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.HashComparator (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.HashComparator (apache-nutch 1.20 API)";
+ parent.document.title="Generator.HashComparator (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.PartitionReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.PartitionReducer.html
index b917a46..bc3d7f2 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.PartitionReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.PartitionReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.PartitionReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.PartitionReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.PartitionReducer (apache-nutch 1.20 API)";
+ parent.document.title="Generator.PartitionReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -348,7 +348,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.Selector.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.Selector.html
index 81e332f..6f18f77 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.Selector.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.Selector.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.Selector (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.Selector (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.Selector (apache-nutch 1.20 API)";
+ parent.document.title="Generator.Selector (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -364,7 +364,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorEntry.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorEntry.html
index e1807a3..7685853 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorEntry.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorEntry.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.SelectorEntry (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.SelectorEntry (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.SelectorEntry (apache-nutch 1.20 API)";
+ parent.document.title="Generator.SelectorEntry (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -427,7 +427,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorInverseMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorInverseMapper.html
index 2d064e0..becb68f 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorInverseMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorInverseMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.SelectorInverseMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.SelectorInverseMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.SelectorInverseMapper (apache-nutch 1.20 API)";
+ parent.document.title="Generator.SelectorInverseMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -348,7 +348,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorMapper.html
index 6201ae0..f04303a 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.SelectorMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.SelectorMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.SelectorMapper (apache-nutch 1.20 API)";
+ parent.document.title="Generator.SelectorMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -370,7 +370,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorReducer.html
index 964325c..f2188fc 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.SelectorReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator.SelectorReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator.SelectorReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator.SelectorReducer (apache-nutch 1.20 API)";
+ parent.document.title="Generator.SelectorReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -412,7 +412,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.html
index 1128b76..e855b63 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Generator.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Generator (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Generator (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Generator (apache-nutch 1.20 API)";
+ parent.document.title="Generator (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -150,11 +150,11 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
<pre>public class <span class="typeNameLabel">Generator</span>
extends <a href="../util/NutchTool.html" title="class in org.apache.nutch.util">NutchTool</a>
implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/util/Tool.html?is-external=true" title="class or interface in org.apache.hadoop.util" class="externalLink">Tool</a></pre>
-<div class="block">Generates a subset of a crawl db to fetch. This version allows to generate
+<div class="block">Generates a subset of a CrawlDb to fetch. This version allows to generate
fetchlists for several segments in one go. Unlike in the initial version
(OldGenerator), the IP resolution is done ONLY on the entries which have been
selected for fetching. The URLs are partitioned by IP, domain or host within
- a segment. We can chose separately how to count the URLS i.e. by domain or
+ a segment. We can choose separately how to count the URLs i.e. by domain or
host to limit the entries.</div>
</li>
</ul>
@@ -414,10 +414,11 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
boolean force)</code></th>
<td class="colLast">
<div class="block"><span class="deprecatedLabel">Deprecated.</span>
-<div class="deprecationComment">since 1.19 use
- <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
- or <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
- in the instance that no hostdb is available</div>
+<div class="deprecationComment">since 1.19 use
+ <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
+ or
+ <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
+ in the instance that no hostdb is available</div>
</div>
</td>
</tr>
@@ -820,10 +821,23 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a>,
<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></pre>
<dl>
+<dt><span class="paramLabel">Parameters:</span></dt>
+<dd><code>dbDir</code> - Crawl database directory</dd>
+<dd><code>segments</code> - Segments directory</dd>
+<dd><code>numLists</code> - Number of fetch lists (partitions) per segment or number of
+ fetcher map tasks. (One fetch list partition is fetched in one
+ fetcher map task.)</dd>
+<dd><code>topN</code> - Number of top URLs to be selected</dd>
+<dd><code>curTime</code> - Current time in milliseconds</dd>
+<dt><span class="returnLabel">Returns:</span></dt>
+<dd>Path to generated segment or null if no entries were selected</dd>
<dt><span class="throwsLabel">Throws:</span></dt>
-<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/IOException.html?is-external=true" title="class or interface in java.io" class="externalLink">IOException</a></code></dd>
-<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code></dd>
-<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></code></dd>
+<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/IOException.html?is-external=true" title="class or interface in java.io" class="externalLink">IOException</a></code> - if an I/O exception occurs.</dd>
+<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or otherwise occupied, and the
+ thread is interrupted, either before or during the activity.</dd>
+<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></code> - if runtime class(es) are not available</dd>
+<dt><span class="seeLabel">See Also:</span></dt>
+<dd><a href="../util/LockUtil.html#createLockFile(org.apache.hadoop.conf.Configuration,org.apache.hadoop.fs.Path,boolean)"><code>LockUtil.createLockFile(Configuration, Path, boolean)</code></a></dd>
</dl>
</li>
</ul>
@@ -845,30 +859,32 @@ public <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop
<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a>,
<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></pre>
<div class="deprecationBlock"><span class="deprecatedLabel">Deprecated.</span>
-<div class="deprecationComment">since 1.19 use
- <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
- or <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
- in the instance that no hostdb is available</div>
+<div class="deprecationComment">since 1.19 use
+ <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String, String)</code></a>
+ or
+ <a href="#generate(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path,int,long,long,boolean,boolean,boolean,int,java.lang.String)"><code>generate(Path, Path, int, long, long, boolean, boolean, boolean, int, String)</code></a>
+ in the instance that no hostdb is available</div>
</div>
-<div class="block">This is an old signature used for compatibility - does not specify whether or not to
- normalise and set the number of segments to 1</div>
+<div class="block">This is an old signature used for compatibility - does not specify whether
+ or not to normalise and set the number of segments to 1</div>
<dl>
<dt><span class="paramLabel">Parameters:</span></dt>
<dd><code>dbDir</code> - Crawl database directory</dd>
<dd><code>segments</code> - Segments directory</dd>
-<dd><code>numLists</code> - Number of reduce tasks</dd>
+<dd><code>numLists</code> - Number of fetch lists (partitions) per segment or number of
+ fetcher map tasks. (One fetch list partition is fetched in one
+ fetcher map task.)</dd>
<dd><code>topN</code> - Number of top URLs to be selected</dd>
<dd><code>curTime</code> - Current time in milliseconds</dd>
<dd><code>filter</code> - whether to apply filtering operation</dd>
-<dd><code>force</code> - if true, and the target lockfile exists, consider it valid. If false
- and the target file exists, throw an IOException.</dd>
+<dd><code>force</code> - if true, and the target lockfile exists, consider it valid. If
+ false and the target file exists, throw an IOException.</dd>
<dt><span class="returnLabel">Returns:</span></dt>
<dd>Path to generated segment or null if no entries were selected</dd>
<dt><span class="throwsLabel">Throws:</span></dt>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/IOException.html?is-external=true" title="class or interface in java.io" class="externalLink">IOException</a></code> - if an I/O exception occurs.</dd>
-<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or
- otherwise occupied, and the thread is interrupted, either before or
- during the activity.</dd>
+<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or otherwise occupied, and the
+ thread is interrupted, either before or during the activity.</dd>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></code> - if runtime class(es) are not available</dd>
<dt><span class="seeLabel">See Also:</span></dt>
<dd><a href="../util/LockUtil.html#createLockFile(org.apache.hadoop.conf.Configuration,org.apache.hadoop.fs.Path,boolean)"><code>LockUtil.createLockFile(Configuration, Path, boolean)</code></a></dd>
@@ -903,22 +919,23 @@ public <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop
<dt><span class="paramLabel">Parameters:</span></dt>
<dd><code>dbDir</code> - Crawl database directory</dd>
<dd><code>segments</code> - Segments directory</dd>
-<dd><code>numLists</code> - Number of reduce tasks</dd>
+<dd><code>numLists</code> - Number of fetch lists (partitions) per segment or number of
+ fetcher map tasks. (One fetch list partition is fetched in one
+ fetcher map task.)</dd>
<dd><code>topN</code> - Number of top URLs to be selected</dd>
<dd><code>curTime</code> - Current time in milliseconds</dd>
<dd><code>filter</code> - whether to apply filtering operation</dd>
<dd><code>norm</code> - whether to apply normalization operation</dd>
-<dd><code>force</code> - if true, and the target lockfile exists, consider it valid. If false
- and the target file exists, throw an IOException.</dd>
+<dd><code>force</code> - if true, and the target lockfile exists, consider it valid. If
+ false and the target file exists, throw an IOException.</dd>
<dd><code>maxNumSegments</code> - maximum number of segments to generate</dd>
<dd><code>expr</code> - a Jexl expression to use in the Generator job.</dd>
<dt><span class="returnLabel">Returns:</span></dt>
<dd>Path to generated segment or null if no entries were selected</dd>
<dt><span class="throwsLabel">Throws:</span></dt>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/IOException.html?is-external=true" title="class or interface in java.io" class="externalLink">IOException</a></code> - if an I/O exception occurs.</dd>
-<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or
- otherwise occupied, and the thread is interrupted, either before or
- during the activity.</dd>
+<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or otherwise occupied, and the
+ thread is interrupted, either before or during the activity.</dd>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></code> - if runtime class(es) are not available</dd>
<dt><span class="seeLabel">See Also:</span></dt>
<dd><a href="../util/JexlUtil.html#parseExpression(java.lang.String)"><code>JexlUtil.parseExpression(String)</code></a>,
@@ -954,24 +971,25 @@ public <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop
<dt><span class="paramLabel">Parameters:</span></dt>
<dd><code>dbDir</code> - Crawl database directory</dd>
<dd><code>segments</code> - Segments directory</dd>
-<dd><code>numLists</code> - Number of reduce tasks</dd>
+<dd><code>numLists</code> - Number of fetch lists (partitions) per segment or number of
+ fetcher map tasks. (One fetch list partition is fetched in one
+ fetcher map task.)</dd>
<dd><code>topN</code> - Number of top URLs to be selected</dd>
<dd><code>curTime</code> - Current time in milliseconds</dd>
<dd><code>filter</code> - whether to apply filtering operation</dd>
<dd><code>norm</code> - whether to apply normalization operation</dd>
-<dd><code>force</code> - if true, and the target lockfile exists, consider it valid. If false
- and the target file exists, throw an IOException.</dd>
+<dd><code>force</code> - if true, and the target lockfile exists, consider it valid. If
+ false and the target file exists, throw an IOException.</dd>
<dd><code>maxNumSegments</code> - maximum number of segments to generate</dd>
<dd><code>expr</code> - a Jexl expression to use in the Generator job.</dd>
<dd><code>hostdb</code> - name of a hostdb from which to execute Jexl expressions in a bid
- to determine the maximum URL count and/or fetch delay per host.</dd>
+ to determine the maximum URL count and/or fetch delay per host.</dd>
<dt><span class="returnLabel">Returns:</span></dt>
<dd>Path to generated segment or null if no entries were selected</dd>
<dt><span class="throwsLabel">Throws:</span></dt>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/IOException.html?is-external=true" title="class or interface in java.io" class="externalLink">IOException</a></code> - if an I/O exception occurs.</dd>
-<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or
- otherwise occupied, and the thread is interrupted, either before or
- during the activity.</dd>
+<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/InterruptedException.html?is-external=true" title="class or interface in java.lang" class="externalLink">InterruptedException</a></code> - if a thread is waiting, sleeping, or otherwise occupied, and the
+ thread is interrupted, either before or during the activity.</dd>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/ClassNotFoundException.html?is-external=true" title="class or interface in java.lang" class="externalLink">ClassNotFoundException</a></code> - if runtime class(es) are not available</dd>
<dt><span class="seeLabel">See Also:</span></dt>
<dd><a href="../util/JexlUtil.html#parseExpression(java.lang.String)"><code>JexlUtil.parseExpression(String)</code></a>,
@@ -1115,7 +1133,7 @@ public <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectMapper.html
index a7946d2..b152e40 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Injector.InjectMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Injector.InjectMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Injector.InjectMapper (apache-nutch 1.20 API)";
+ parent.document.title="Injector.InjectMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -456,7 +456,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectReducer.html
index 2ff71b1..fdd93c9 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.InjectReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Injector.InjectReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Injector.InjectReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Injector.InjectReducer (apache-nutch 1.20 API)";
+ parent.document.title="Injector.InjectReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -382,7 +382,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.html
index 03fef24..59ded09 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Injector.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Injector (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Injector (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Injector (apache-nutch 1.20 API)";
+ parent.document.title="Injector (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -679,7 +679,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlink.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlink.html
index 38c71b4..ce1c2f8 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlink.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlink.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Inlink (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Inlink (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,20 +15,20 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Inlink (apache-nutch 1.20 API)";
+ parent.document.title="Inlink (apache-nutch 1.21 API)";
}
}
catch(err) {
}
//-->
-var data = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":9,"i5":10,"i6":9,"i7":10,"i8":10};
+var data = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":9,"i6":10,"i7":10,"i8":9,"i9":10,"i10":10};
var tabs = {65535:["t0","All Methods"],1:["t1","Static Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
var altColor = "altColor";
var rowColor = "rowColor";
@@ -203,33 +203,43 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
<td class="colLast"> </td>
</tr>
<tr id="i3" class="rowColor">
+<td class="colFirst"><code><a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/MapWritable.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">MapWritable</a></code></td>
+<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#getMetadata()">getMetadata</a></span>()</code></th>
+<td class="colLast"> </td>
+</tr>
+<tr id="i4" class="altColor">
<td class="colFirst"><code>int</code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#hashCode()">hashCode</a></span>()</code></th>
<td class="colLast"> </td>
</tr>
-<tr id="i4" class="altColor">
+<tr id="i5" class="rowColor">
<td class="colFirst"><code>static <a href="Inlink.html" title="class in org.apache.nutch.crawl">Inlink</a></code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#read(java.io.DataInput)">read</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/DataInput.html?is-external=true" title="class or interface in java.io" class="externalLink">DataInput</a> in)</code></th>
<td class="colLast"> </td>
</tr>
-<tr id="i5" class="rowColor">
+<tr id="i6" class="altColor">
<td class="colFirst"><code>void</code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#readFields(java.io.DataInput)">readFields</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/DataInput.html?is-external=true" title="class or interface in java.io" class="externalLink">DataInput</a> in)</code></th>
<td class="colLast"> </td>
</tr>
-<tr id="i6" class="altColor">
+<tr id="i7" class="rowColor">
+<td class="colFirst"><code>void</code></td>
+<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#setMetadata(org.apache.hadoop.io.MapWritable)">setMetadata</a></span>​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/MapWritable.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">MapWritable</a> md)</code></th>
+<td class="colLast"> </td>
+</tr>
+<tr id="i8" class="altColor">
<td class="colFirst"><code>static void</code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#skip(java.io.DataInput)">skip</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/DataInput.html?is-external=true" title="class or interface in java.io" class="externalLink">DataInput</a> in)</code></th>
<td class="colLast">
<div class="block">Skips over one Inlink in the input.</div>
</td>
</tr>
-<tr id="i7" class="rowColor">
+<tr id="i9" class="rowColor">
<td class="colFirst"><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a></code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#toString()">toString</a></span>()</code></th>
<td class="colLast"> </td>
</tr>
-<tr id="i8" class="altColor">
+<tr id="i10" class="altColor">
<td class="colFirst"><code>void</code></td>
<th class="colSecond" scope="row"><code><span class="memberNameLink"><a href="#write(java.io.DataOutput)">write</a></span>​(<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/DataOutput.html?is-external=true" title="class or interface in java.io" class="externalLink">DataOutput</a> out)</code></th>
<td class="colLast"> </td>
@@ -368,6 +378,24 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
<pre class="methodSignature">public <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/String.html?is-external=true" title="class or interface in java.lang" class="externalLink">String</a> getAnchor()</pre>
</li>
</ul>
+<a id="getMetadata()">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>getMetadata</h4>
+<pre class="methodSignature">public <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/MapWritable.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">MapWritable</a> getMetadata()</pre>
+</li>
+</ul>
+<a id="setMetadata(org.apache.hadoop.io.MapWritable)">
+<!-- -->
+</a>
+<ul class="blockList">
+<li class="blockList">
+<h4>setMetadata</h4>
+<pre class="methodSignature">public void setMetadata​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/MapWritable.html?is-external=true" title="class or interface in org.apache.hadoop.io" class="externalLink">MapWritable</a> md)</pre>
+</li>
+</ul>
<a id="equals(java.lang.Object)">
<!-- -->
</a>
@@ -476,7 +504,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlinks.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlinks.html
index 08cff53..5f3e4de 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlinks.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Inlinks.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Inlinks (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Inlinks (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Inlinks (apache-nutch 1.20 API)";
+ parent.document.title="Inlinks (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -446,7 +446,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.LinkDbMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.LinkDbMapper.html
index 8d756dd..75acc1d 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.LinkDbMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.LinkDbMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDb.LinkDbMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDb.LinkDbMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDb.LinkDbMapper (apache-nutch 1.20 API)";
+ parent.document.title="LinkDb.LinkDbMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.html
index 0604646..61f81be 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDb.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDb (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDb (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDb (apache-nutch 1.20 API)";
+ parent.document.title="LinkDb (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -624,7 +624,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbFilter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbFilter.html
index 0efe908..e1ba230 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbFilter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbFilter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDbFilter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDbFilter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDbFilter (apache-nutch 1.20 API)";
+ parent.document.title="LinkDbFilter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -450,7 +450,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.LinkDbMergeReducer.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.LinkDbMergeReducer.html
index cfe9ce9..aee7005 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.LinkDbMergeReducer.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.LinkDbMergeReducer.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDbMerger.LinkDbMergeReducer (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDbMerger.LinkDbMergeReducer (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDbMerger.LinkDbMergeReducer (apache-nutch 1.20 API)";
+ parent.document.title="LinkDbMerger.LinkDbMergeReducer (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.html
index 029555e..4d9fde3 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbMerger.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDbMerger (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDbMerger (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDbMerger (apache-nutch 1.20 API)";
+ parent.document.title="LinkDbMerger (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -465,7 +465,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.LinkDBDumpMapper.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.LinkDBDumpMapper.html
index 8e34c97..0c0e000 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.LinkDBDumpMapper.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.LinkDBDumpMapper.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDbReader.LinkDBDumpMapper (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDbReader.LinkDBDumpMapper (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDbReader.LinkDBDumpMapper (apache-nutch 1.20 API)";
+ parent.document.title="LinkDbReader.LinkDBDumpMapper (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -366,7 +366,7 @@ extends <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/map
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.html
index 15376f9..ec7e50a 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/LinkDbReader.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>LinkDbReader (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>LinkDbReader (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="LinkDbReader (apache-nutch 1.20 API)";
+ parent.document.title="LinkDbReader (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -574,7 +574,7 @@ implements <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/io/C
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/MD5Signature.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/MD5Signature.html
index 20248fd..25d632b 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/MD5Signature.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/MD5Signature.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>MD5Signature (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>MD5Signature (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="MD5Signature (apache-nutch 1.20 API)";
+ parent.document.title="MD5Signature (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -348,7 +348,7 @@ extends <a href="Signature.html" title="class in org.apache.nutch.crawl">Signatu
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/MimeAdaptiveFetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/MimeAdaptiveFetchSchedule.html
index 927bcd8..268b234 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/MimeAdaptiveFetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/MimeAdaptiveFetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>MimeAdaptiveFetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>MimeAdaptiveFetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="MimeAdaptiveFetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="MimeAdaptiveFetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -296,7 +296,7 @@ extends <a href="AdaptiveFetchSchedule.html" title="class in org.apache.nutch.cr
<!-- -->
</a>
<h3>Methods inherited from class org.apache.nutch.crawl.<a href="AdaptiveFetchSchedule.html" title="class in org.apache.nutch.crawl">AdaptiveFetchSchedule</a></h3>
-<code><a href="AdaptiveFetchSchedule.html#getHostName(java.lang.String)">getHostName</a>, <a href="AdaptiveFetchSchedule.html#getMaxInterval(org.apache.hadoop.io.Text,float)">getMaxInterval</a>, <a href="AdaptiveFetchSchedule.html#getMinInterval(org.apache.hadoop.io.Text,float)">getMinInterval</a></code></li>
+<code><a href="AdaptiveFetchSchedule.html#getCustomMaxInterval(org.apache.hadoop.io.Text)">getCustomMaxInterval</a>, <a href="AdaptiveFetchSchedule.html#getCustomMinInterval(org.apache.hadoop.io.Text)">getCustomMinInterval</a>, <a href="AdaptiveFetchSchedule.html#getHostName(java.lang.String)">getHostName</a></code></li>
</ul>
<ul class="blockList">
<li class="blockList"><a id="methods.inherited.from.class.org.apache.nutch.crawl.AbstractFetchSchedule">
@@ -560,7 +560,7 @@ extends <a href="AdaptiveFetchSchedule.html" title="class in org.apache.nutch.cr
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/NutchWritable.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/NutchWritable.html
index 146adc2..014cc89 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/NutchWritable.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/NutchWritable.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>NutchWritable (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>NutchWritable (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="NutchWritable (apache-nutch 1.20 API)";
+ parent.document.title="NutchWritable (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -351,7 +351,7 @@ extends <a href="../util/GenericWritableConfigurable.html" title="class in org.a
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/Signature.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/Signature.html
index d14f6ed..a28d9f8 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/Signature.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/Signature.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Signature (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Signature (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Signature (apache-nutch 1.20 API)";
+ parent.document.title="Signature (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -391,7 +391,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureComparator.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureComparator.html
index 39d2d0f..bd23525 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureComparator.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureComparator.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>SignatureComparator (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>SignatureComparator (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="SignatureComparator (apache-nutch 1.20 API)";
+ parent.document.title="SignatureComparator (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -360,7 +360,7 @@ implements <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/util
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureFactory.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureFactory.html
index 9475edf..acc88e3 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureFactory.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/SignatureFactory.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>SignatureFactory (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>SignatureFactory (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="SignatureFactory (apache-nutch 1.20 API)";
+ parent.document.title="SignatureFactory (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -280,7 +280,7 @@ extends <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java/lang/Ob
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/TextMD5Signature.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/TextMD5Signature.html
index a1a7643..a8b222d 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/TextMD5Signature.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/TextMD5Signature.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>TextMD5Signature (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>TextMD5Signature (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="TextMD5Signature (apache-nutch 1.20 API)";
+ parent.document.title="TextMD5Signature (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -344,7 +344,7 @@ extends <a href="Signature.html" title="class in org.apache.nutch.crawl">Signatu
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/TextProfileSignature.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/TextProfileSignature.html
index b07008c..7f4ae9c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/TextProfileSignature.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/TextProfileSignature.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>TextProfileSignature (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>TextProfileSignature (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="TextProfileSignature (apache-nutch 1.20 API)";
+ parent.document.title="TextProfileSignature (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -410,7 +410,7 @@ extends <a href="Signature.html" title="class in org.apache.nutch.crawl">Signatu
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/URLPartitioner.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/URLPartitioner.html
index fabec3e..0750e9c 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/URLPartitioner.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/URLPartitioner.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>URLPartitioner (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>URLPartitioner (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="URLPartitioner (apache-nutch 1.20 API)";
+ parent.document.title="URLPartitioner (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -461,7 +461,7 @@ implements <a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AbstractFetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AbstractFetchSchedule.html
index 7cbebdc..1c5f0e4 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AbstractFetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AbstractFetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.AbstractFetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.AbstractFetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.crawl.AbstractFetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.crawl.AbstractFetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -207,7 +207,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AdaptiveFetchSchedule.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AdaptiveFetchSchedule.html
index 74c03af..cf98467 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AdaptiveFetchSchedule.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/AdaptiveFetchSchedule.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.AdaptiveFetchSchedule (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.AdaptiveFetchSchedule (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.crawl.AdaptiveFetchSchedule (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.crawl.AdaptiveFetchSchedule (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -193,7 +193,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.Comparator.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.Comparator.html
index 59d8aed..073fc90 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.Comparator.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.Comparator.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.CrawlDatum.Comparator (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.CrawlDatum.Comparator (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDatum.Comparator (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDatum.Comparator (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -144,7 +144,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.html
index 79a9b10..77faa08 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDatum.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.CrawlDatum (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.CrawlDatum (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDatum (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDatum (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -357,31 +357,25 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</td>
</tr>
<tr class="rowColor">
-<th class="colFirst" scope="row"><a href="#org.apache.nutch.scoring.tld">org.apache.nutch.scoring.tld</a></th>
-<td class="colLast">
-<div class="block">Top Level Domain Scoring plugin.</div>
-</td>
-</tr>
-<tr class="altColor">
<th class="colFirst" scope="row"><a href="#org.apache.nutch.scoring.urlmeta">org.apache.nutch.scoring.urlmeta</a></th>
<td class="colLast">
<div class="block">URL Meta Tag Scoring Plugin</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="#org.apache.nutch.segment">org.apache.nutch.segment</a></th>
<td class="colLast">
<div class="block">A segment stores all data from on generate/fetch/update cycle:
fetch list, protocol status, raw content, parsed content, and extracted outgoing links.</div>
</td>
</tr>
-<tr class="altColor">
+<tr class="rowColor">
<th class="colFirst" scope="row"><a href="#org.apache.nutch.util">org.apache.nutch.util</a></th>
<td class="colLast">
<div class="block">Miscellaneous utility classes.</div>
</td>
</tr>
-<tr class="rowColor">
+<tr class="altColor">
<th class="colFirst" scope="row"><a href="#org.creativecommons.nutch">org.creativecommons.nutch</a></th>
<td class="colLast">
<div class="block">Sample plugins that parse and index Creative Commons metadata.</div>
@@ -2919,34 +2913,6 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</section>
</li>
<li class="blockList">
-<section><a id="org.apache.nutch.scoring.tld">
-<!-- -->
-</a>
-<h3>Uses of <a href="../CrawlDatum.html" title="class in org.apache.nutch.crawl">CrawlDatum</a> in <a href="../../scoring/tld/package-summary.html">org.apache.nutch.scoring.tld</a></h3>
-<table class="useSummary">
-<caption><span>Methods in <a href="../../scoring/tld/package-summary.html">org.apache.nutch.scoring.tld</a> with parameters of type <a href="../CrawlDatum.html" title="class in org.apache.nutch.crawl">CrawlDatum</a></span><span class="tabEnd"> </span></caption>
-<tr>
-<th class="colFirst" scope="col">Modifier and Type</th>
-<th class="colSecond" scope="col">Method</th>
-<th class="colLast" scope="col">Description</th>
-</tr>
-<tbody>
-<tr class="altColor">
-<td class="colFirst"><code>float</code></td>
-<th class="colSecond" scope="row"><span class="typeNameLabel">TLDScoringFilter.</span><code><span class="memberNameLink"><a href="../../scoring/tld/TLDScoringFilter.html#indexerScore(org.apache.hadoop.io.Text,org.apache.nutch.indexer.NutchDocument,org.apache.nutch.crawl.CrawlDatum,org.apache.nutch.crawl.CrawlDatum,org.apache.nutch.parse.Parse,org.apache.nutch.crawl.Inlinks,float)">indexerScore</a></span>​(<a href="https://hadoop.apache.org/docs/r3.3.6/api/org/apache/hadoop/io/Text. [...]
- <a href="../../indexer/NutchDocument.html" title="class in org.apache.nutch.indexer">NutchDocument</a> doc,
- <a href="../CrawlDatum.html" title="class in org.apache.nutch.crawl">CrawlDatum</a> dbDatum,
- <a href="../CrawlDatum.html" title="class in org.apache.nutch.crawl">CrawlDatum</a> fetchDatum,
- <a href="../../parse/Parse.html" title="interface in org.apache.nutch.parse">Parse</a> parse,
- <a href="../Inlinks.html" title="class in org.apache.nutch.crawl">Inlinks</a> inlinks,
- float initScore)</code></th>
-<td class="colLast"> </td>
-</tr>
-</tbody>
-</table>
-</section>
-</li>
-<li class="blockList">
<section><a id="org.apache.nutch.scoring.urlmeta">
<!-- -->
</a>
@@ -3216,7 +3182,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDb.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDb.html
index 9c76dd9..d559fda 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDb.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDb.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.CrawlDb (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.CrawlDb (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDb (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDb (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -144,7 +144,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbFilter.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbFilter.html
index e65d0fa..9adbf28 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbFilter.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbFilter.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.CrawlDbFilter (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.CrawlDbFilter (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
-<meta name="dc.created" content="2024-04-09">
+<meta name="dc.created" content="2025-07-16">
<link rel="stylesheet" type="text/css" href="../../../../../stylesheet.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery/jquery-ui.min.css" title="Style">
<link rel="stylesheet" type="text/css" href="../../../../../jquery-ui.overrides.css" title="Style">
@@ -15,14 +15,14 @@
<!--[if IE]>
<script type="text/javascript" src="../../../../../jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script>
<![endif]-->
-<script type="text/javascript" src="../../../../../jquery/jquery-3.6.1.min.js"></script>
+<script type="text/javascript" src="../../../../../jquery/jquery-3.7.1.min.js"></script>
<script type="text/javascript" src="../../../../../jquery/jquery-ui.min.js"></script>
</head>
<body>
<script type="text/javascript"><!--
try {
if (location.href.indexOf('is-external=true') == -1) {
- parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDbFilter (apache-nutch 1.20 API)";
+ parent.document.title="Uses of Class org.apache.nutch.crawl.CrawlDbFilter (apache-nutch 1.21 API)";
}
}
catch(err) {
@@ -144,7 +144,7 @@ $('.navPadding').css('padding-top', $('.fixedNav').css("height"));
</a></div>
<!-- ======== END OF BOTTOM NAVBAR ======= -->
</nav>
-<p class="legalCopy"><small>Copyright © 2024 The Apache Software Foundation</small></p>
+<p class="legalCopy"><small>Copyright © 2025 The Apache Software Foundation</small></p>
</footer>
</body>
</html>
diff --git a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbMerger.Merger.html b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbMerger.Merger.html
index ecf3f92..49cea9f 100644
--- a/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbMerger.Merger.html
+++ b/content/documentation/javadoc/api/org/apache/nutch/crawl/class-use/CrawlDbMerger.Merger.html
@@ -2,10 +2,10 @@
<!-- NewPage -->
<html lang="en">
<head>
-<!-- Generated by javadoc (11.0.22) on Tue Apr 09 09:55:33 PDT 2024 -->
-<title>Uses of Class org.apache.nutch.crawl.CrawlDbMerger.Merger (apache-nutch 1.20 API)</title>
+<!-- Generated by javadoc (11.0.27) on Wed Jul 16 12:49:41 CEST 2025 -->
+<title>Uses of Class org.apache.nutch.crawl.CrawlDbMerger.Merger (apache-nutch 1.21 API)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
... 60567 lines suppressed ...
(nutch-site) 03/04: Add dates to the news items listed on the news overview page
Posted by sn...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
snagel pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nutch-site.git
commit 0ff1d8392e2131b5c03edccf7cd88043805de878
Author: Sebastian Nagel <sn...@apache.org>
AuthorDate: Sun Jul 20 19:53:31 2025 +0200
Add dates to the news items listed on the news overview page
---
content/news/nutch-1.18-release.md | 2 +-
content/news/nutch-1.19-release.md | 2 +-
content/news/nutch-1.20-release.md | 2 +-
3 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/content/news/nutch-1.18-release.md b/content/news/nutch-1.18-release.md
index 065546b..7414e03 100644
--- a/content/news/nutch-1.18-release.md
+++ b/content/news/nutch-1.18-release.md
@@ -4,7 +4,7 @@ title = "Nutch 1.18 Release"
tags = ["1.18","release"]
categories = ["releases"]
draft = false
-description = "This news announces the Apache Nutch 1.18 release."
+description = "21 January 2021 – releasing Apache Nutch 1.18"
weight = 10
+++
diff --git a/content/news/nutch-1.19-release.md b/content/news/nutch-1.19-release.md
index 774345b..537bb0c 100644
--- a/content/news/nutch-1.19-release.md
+++ b/content/news/nutch-1.19-release.md
@@ -4,7 +4,7 @@ title = "Nutch 1.19 Release"
tags = ["1.19","release"]
categories = ["releases"]
draft = false
-description = "This news announces the Apache Nutch 1.19 release."
+description = "22 August 2022 – Apache Nutch 1.19 has been released."
weight = 10
+++
diff --git a/content/news/nutch-1.20-release.md b/content/news/nutch-1.20-release.md
index c91b468..cfcc401 100644
--- a/content/news/nutch-1.20-release.md
+++ b/content/news/nutch-1.20-release.md
@@ -4,7 +4,7 @@ title = "Nutch 1.20 Release"
tags = ["1.20","release"]
categories = ["releases"]
draft = false
-description = "This news announces the Apache Nutch 1.20 release."
+description = "25 April 2024 – we are pleased to announce the release of Apache Nutch 1.20"
weight = 10
+++
(nutch-site) 01/04: Link to RFC 9309 which Nutch (relying on crawler-commons) is following as robots.txt standard since Nutch 1.19
Posted by sn...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
snagel pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nutch-site.git
commit 607dc40083c741aa42086ae8e77d46b7f864b5cf
Author: Sebastian Nagel <sn...@apache.org>
AuthorDate: Sun Jul 20 19:40:47 2025 +0200
Link to RFC 9309 which Nutch (relying on crawler-commons)
is following as robots.txt standard since Nutch 1.19
---
content/community/bot.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/content/community/bot.md b/content/community/bot.md
index 0c33b84..fff55e5 100644
--- a/content/community/bot.md
+++ b/content/community/bot.md
@@ -13,7 +13,7 @@ If you're reading this, chances are you've seen a Nutch-based robot visiting you
# Sysadmins/robots.txt
We're a software project, not a service, so please understand that a misbehaving crawler appearing with our Agent string is not run by us. Our software may be run by anyone. However, we'd still like to hear about any bad behavior. If possible, please include the name of the domain and some representative log entries. We can be reached at `dev[at]nutch[dot]apache[dot]org`
-Our software obeys the <a href="http://www.robotstxt.org/robotstxt.html" target="_blank">robots.txt exclusion standard</a>. Different Nutch deployments may specify different agent names, but all should respond to the agent name "Nutch". Thus to ban all Nutch-based crawlers from your site, place the following in your robots.txt file:
+Our software obeys the <a href="https://en.wikipedia.org/wiki/Robots_exclusion_standard" target="_blank">robots.txt exclusion standard</a> as specified in <a href="https://datatracker.ietf.org/doc/html/rfc9309">RFC 9309</a>. Different Nutch deployments may specify different agent names, but all should respond to the agent name "Nutch". Thus to ban all Nutch-based crawlers from your site, place the following in your robots.txt file:
```
User-agent: Nutch
@@ -21,4 +21,4 @@ Disallow: /
```
# Webmasters/Robots META
- If you do not have permission to edit the `/robots.txt` file on your server, you can still tell robots not to index your pages or follow your links. The standard mechanism for this is the <a href="http://www.robotstxt.org/meta.html" target="_blank">robots META tag</a>.
\ No newline at end of file
+ If you do not have permission to edit the `/robots.txt` file on your server, you can still tell robots not to index your pages or follow your links. The standard mechanism for this is the <a href="https://www.robotstxt.org/meta.html" target="_blank">robots META tag</a>.
\ No newline at end of file