You are viewing a plain text version of this content. The canonical link for it is here.
- [nutch] branch master updated (f0161ea -> 5399ce0) - posted by sn...@apache.org on 2020/08/02 11:09:58 UTC, 0 replies.
- [nutch] branch master updated (5399ce0 -> e33aaa1) - posted by ba...@apache.org on 2020/08/03 15:10:54 UTC, 0 replies.
- svn commit: r1880550 - in /nutch/cms_site/trunk: content/credits.md templates/std.html - posted by sn...@apache.org on 2020/08/03 15:27:59 UTC, 0 replies.
- svn commit: r1063813 - in /websites/staging/nutch/trunk/content: ./ assets/js/README.html bot.html credits.html downloads.html index.html javadoc.html mailing_lists.html version_control.html - posted by bu...@apache.org on 2020/08/03 15:29:34 UTC, 0 replies.
- svn commit: r1880551 - /nutch/cms_site/trunk/content/credits.md - posted by sn...@apache.org on 2020/08/03 15:30:58 UTC, 0 replies.
- svn commit: r1063814 - in /websites/staging/nutch/trunk/content: ./ credits.html - posted by bu...@apache.org on 2020/08/03 15:31:32 UTC, 0 replies.
- svn commit: r1880552 - /nutch/cms_site/trunk/content/credits.md - posted by sn...@apache.org on 2020/08/03 15:34:05 UTC, 0 replies.
- svn commit: r1063815 - in /websites/staging/nutch/trunk/content: ./ credits.html - posted by bu...@apache.org on 2020/08/03 15:34:37 UTC, 0 replies.
- svn commit: r1063816 - /websites/production/nutch/content/ - posted by sn...@apache.org on 2020/08/03 15:55:59 UTC, 0 replies.
- [nutch] branch master updated (e33aaa1 -> 2f5a8ad) - posted by sn...@apache.org on 2020/08/03 19:06:58 UTC, 0 replies.
- [nutch] branch master updated: NUTCH-2810 FreeGenerator to actually apply configured number of fetch lists - posted by sn...@apache.org on 2020/08/03 19:08:30 UTC, 0 replies.
- [nutch] branch master updated: NUTCH-2816 Add Spotbugs target to ant build - called on-demand as ant target "spotbugs" - creates spotbugs report ("build/nutch-spotbugs.html") covering Nutch core and plugins - posted by sn...@apache.org on 2020/08/11 07:37:37 UTC, 0 replies.
- [nutch] branch master updated: NUTCH-2817 Avoid check for equality of URL path and file part using ==/!= - replace check whether URL path and file are identical by check whether URL has a query - clean up code and improve log messages - posted by sn...@apache.org on 2020/08/11 07:38:57 UTC, 0 replies.
- [nutch] branch master updated (466cac5 -> ae844b6) - posted by sn...@apache.org on 2020/08/16 19:04:14 UTC, 0 replies.
- [nutch] 01/35: NUTCH-2743 Add list of Nutch properties (nutch-default.xml) to documentation - modify ant build.xml to copy nutch-default.xml into docs/api/resources/ - adapt XSLT table layout - remove obsolete nutch-conf.xsl - fix typos and normalize spelling in nutch-default.xml - posted by sn...@apache.org on 2020/08/16 19:04:15 UTC, 0 replies.
- [nutch] 02/35: NUTCH-2434 Add methods to reset parameters HTMLMetaTags (apply patch contributed by Markus) - posted by sn...@apache.org on 2020/08/16 19:04:16 UTC, 0 replies.
- [nutch] 03/35: NUTCH-1194 Generator: CrawlDB lock should be released earlier - release CrawlDb lock after select step, in case, generated items are not marked in CrawlDb (generate.update.crawldb is false) - posted by sn...@apache.org on 2020/08/16 19:04:17 UTC, 0 replies.
- [nutch] 04/35: NUTCH-2785 FreeGenerator: command-line option to define number of generated fetch lists - add command-line option `-numFetchers` to FreeGenerator - in local mode: generate one single fetch list - posted by sn...@apache.org on 2020/08/16 19:04:18 UTC, 0 replies.
- [nutch] 05/35: NUTCH-2002 parse and index checkers to check robots.txt - applied Julien's patch to recent code base - also check redirects whether they are allowed - add command-line parameter `-checkRobotsTxt` enabling this check - posted by sn...@apache.org on 2020/08/16 19:04:19 UTC, 0 replies.
- [nutch] 06/35: NUTCH-2753 Add -listen option to command-line help of CrawlDbReader and LinkDbReader - posted by sn...@apache.org on 2020/08/16 19:04:20 UTC, 0 replies.
- [nutch] 07/35: NUTCH-2758 Add plugin READMEs to binary release packages - posted by sn...@apache.org on 2020/08/16 19:04:21 UTC, 0 replies.
- [nutch] 08/35: NUTCH-1945 Test for XLSX parser - add Tika unit test for XLSX files - bundle instance variables and utility methods in class TikaParserTest - clean up javadoc comments - posted by sn...@apache.org on 2020/08/16 19:04:22 UTC, 0 replies.
- [nutch] 09/35: NUTCH-2419 Some URL filters and normalizers do not respect command-line override for rule file - posted by sn...@apache.org on 2020/08/16 19:04:23 UTC, 0 replies.
- [nutch] 10/35: NUTCH-2419 Some URL filters and normalizers do not respect command-line override for rule file - posted by sn...@apache.org on 2020/08/16 19:04:24 UTC, 0 replies.
- [nutch] 11/35: NUTCH-2720 ROBOTS metatag ignored when capitalized - posted by sn...@apache.org on 2020/08/16 19:04:25 UTC, 0 replies.
- [nutch] 12/35: NUTCH-2720 ROBOTS metatag ignored when capitalized - move string "robots" to constant in metadata.Nutch - make string lowercase not depend on system locale - posted by sn...@apache.org on 2020/08/16 19:04:26 UTC, 0 replies.
- [nutch] 13/35: NUTCH-2496 Speed up link inversion step in crawling script - posted by sn...@apache.org on 2020/08/16 19:04:27 UTC, 0 replies.
- [nutch] 14/35: NUTCH-2790 indexer-csv: escape field leading quote character - posted by sn...@apache.org on 2020/08/16 19:04:28 UTC, 0 replies.
- [nutch] 15/35: NUTCH-2787 CrawlDb JSON dump does not export metadata primitive data types correctly - add JsonSerializer to write common Writable types (null, boolean, numbers) - remaining "unknown" Writables are written after calling toString() - posted by sn...@apache.org on 2020/08/16 19:04:29 UTC, 0 replies.
- [nutch] 16/35: NUTCH-2788 ParseData: improve presentation of Metadata in method toString() - switch to multi-line presentation of Metadata in ParseData::toString - default implementation of Metadata::toString is still single-line - replace StringBuffer by StringBuilder in modified methods - posted by sn...@apache.org on 2020/08/16 19:04:30 UTC, 0 replies.
- [nutch] 17/35: NUTCH-2789 Docker README: update links to point to cwiki - posted by sn...@apache.org on 2020/08/16 19:04:31 UTC, 0 replies.
- [nutch] 18/35: NUTCH-2789 Documentation: update links to point to cwiki - posted by sn...@apache.org on 2020/08/16 19:04:32 UTC, 0 replies.
- [nutch] 19/35: NUTCH-2791 Handle GCS URLs in stats commands - posted by sn...@apache.org on 2020/08/16 19:04:33 UTC, 0 replies.
- [nutch] 20/35: NUTCH-2794 Add additional ciphers to HTTP base's default cipher suite - posted by sn...@apache.org on 2020/08/16 19:04:34 UTC, 0 replies.
- [nutch] 21/35: Prepare for new development after release of 1.17 - bump version number (1.17-SNAPSHOT -> 1.18-SNAPSHOT) - add 1.17 changes / release notes - update links to Hadoop and Solr API docs - update current year in API docs etc. - posted by sn...@apache.org on 2020/08/16 19:04:35 UTC, 0 replies.
- [nutch] 22/35: [NUTCH-2796] Upgrade to crawler-commons 1.1 - posted by sn...@apache.org on 2020/08/16 19:04:36 UTC, 0 replies.
- [nutch] 23/35: [NUTCH-2730] SitemapProcessor to treat sitemap URLs as Set instead of List - sitemap links from robots.txt are treated as set by crawler-commons (since crawler-commons 1.1) - sitemaps referenced in sitemap index are deduplicated - posted by sn...@apache.org on 2020/08/16 19:04:37 UTC, 0 replies.
- [nutch] 24/35: NUTCH-2782: protocol-http / lib-http: support TLSv1.3 - posted by sn...@apache.org on 2020/08/16 19:04:38 UTC, 0 replies.
- [nutch] 25/35: NUTCH-2805: Rename plugin urlfilter-domainblacklist (#540) - posted by sn...@apache.org on 2020/08/16 19:04:39 UTC, 0 replies.
- [nutch] 26/35: NUTCH-2799 Add .asf.yaml file - add project description in one sentence - add github topics - set github mailing list notifications as configured before - posted by sn...@apache.org on 2020/08/16 19:04:40 UTC, 0 replies.
- [nutch] 27/35: NUTCH-2799 Add .asf.yaml file - update pull request template regarding Jira linking: issue id should be in square brackets (`[NUTCH-XXXX]`) - posted by sn...@apache.org on 2020/08/16 19:04:41 UTC, 0 replies.
- [nutch] 28/35: NUTCH-1190 MoreIndexingFilter: move data formats used to parse "lastModified" to a config file - posted by sn...@apache.org on 2020/08/16 19:04:42 UTC, 0 replies.
- [nutch] 29/35: [NUTCH-2801] RobotsRulesParser command-line checker to use http.robots.agents as fall-back - if no agent names are given as command-line arguments use values of http.agent.name and http.robots.agents as agent names to be checked - update command-line help - posted by sn...@apache.org on 2020/08/16 19:04:43 UTC, 0 replies.
- [nutch] 30/35: [NUTCH-2801] RobotsRulesParser command-line checker to use http.robots.agents as fall-back - clarify comment regarding bypassing the confidence check for a non-empty http.agent.name - posted by sn...@apache.org on 2020/08/16 19:04:44 UTC, 0 replies.
- [nutch] 31/35: NUTCH-2810 FreeGenerator to actually apply configured number of fetch lists - posted by sn...@apache.org on 2020/08/16 19:04:45 UTC, 0 replies.
- [nutch] 32/35: NUTCH-2811 : Setup Github workflows for prs (#543) - posted by sn...@apache.org on 2020/08/16 19:04:46 UTC, 0 replies.
- [nutch] 33/35: NUTCH-2816 Add Spotbugs target to ant build - called on-demand as ant target "spotbugs" - creates spotbugs report ("build/nutch-spotbugs.html") covering Nutch core and plugins - posted by sn...@apache.org on 2020/08/16 19:04:47 UTC, 0 replies.
- [nutch] 34/35: NUTCH-2817 Avoid check for equality of URL path and file part using ==/!= - replace check whether URL path and file are identical by check whether URL has a query - clean up code and improve log messages - posted by sn...@apache.org on 2020/08/16 19:04:48 UTC, 0 replies.
- [nutch] 35/35: Merge branch 'derhecht-patch-2', closes #545 - posted by sn...@apache.org on 2020/08/16 19:04:49 UTC, 0 replies.
- [nutch] branch master updated: NUTCH-2697 Upgrade Ivy to fix the issue of an unset packaging.type property NUTCH-2671 Upgrade ant ivy library - upgrade Ivy (2.4.0 -> 2.5.0) - upgrade all plugins build-ivy.xml to use the ivy jar 2.5.0 installed in $NUTCH_HOME/ivy/ for preparing lists of dependencies registered in plugin.xml - posted by sn...@apache.org on 2020/08/17 13:45:42 UTC, 0 replies.
- [nutch] branch master updated: NUTCH-2814 HttpDateFormat's internal time zone may change after parsing a date - reset time zone to GMT after parsing a date - posted by sn...@apache.org on 2020/08/18 09:41:53 UTC, 0 replies.
- [nutch] branch master updated: NUTCH-2818 Fix Apache Rat task to check sources for license headers - automatize download of Apache Rat jar file - write report to build/apache-rat-report.txt - posted by sn...@apache.org on 2020/08/18 09:49:51 UTC, 0 replies.