You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nutch.apache.org by le...@apache.org on 2021/01/14 23:28:37 UTC
[nutch] branch branch-1.18 created (now e9f125c)
This is an automated email from the ASF dual-hosted git repository.
lewismc pushed a change to branch branch-1.18
in repository https://gitbox.apache.org/repos/asf/nutch.git.
at e9f125c Prepare for Nutch 1.18 release
This branch includes the following new commits:
new e9f125c Prepare for Nutch 1.18 release
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[nutch] 01/01: Prepare for Nutch 1.18 release
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lewismc pushed a commit to branch branch-1.18
in repository https://gitbox.apache.org/repos/asf/nutch.git
commit e9f125c62ae71903187959351b0f72da29937749
Author: Lewis John McGibbney <le...@gmail.com>
AuthorDate: Thu Jan 14 15:27:00 2021 -0800
Prepare for Nutch 1.18 release
---
CHANGES.txt | 50 ++++++++++++++++++++++++++++++++++++++++++++++++--
NOTICE.txt | 2 +-
conf/nutch-default.xml | 2 +-
default.properties | 4 ++--
src/bin/nutch | 2 +-
5 files changed, 53 insertions(+), 7 deletions(-)
diff --git a/CHANGES.txt b/CHANGES.txt
index e5c5984..0613585 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,10 +1,56 @@
# Nutch Change Log
-Nutch 1.18 Development
+Nutch 1.18 Release 14/01/2021 (dd/mm/yyyy)
+Release Report: https://s.apache.org/lqara
Breaking Changes
- - As part of NUTCH-2805, the plugin urlfilter-domainblacklist has been renamed to urlfilter-domaindenylist. And the fields required for the plugin urlfilter.domainblacklist.rules and urlfilter.domainblacklist.file has been replaced with urlfilter.domaindenylist.rules and urlfilter.domaindenylist.file respectively. See NUTCH-2802 for more details.
+ - As part of NUTCH-2805, the plugin urlfilter-domainblacklist has been renamed to urlfilter-domaindenylist. And the fields required for the plugin urlfilter.domainblacklist.rules and urlfilter.domainblacklist.file has been replaced with urlfilter.domaindenylist.rules and urlfilter.domaindenylist.file respectively. See NUTCH-2802 for more details.
+
+Sub-task
+
+ [NUTCH-2671] - Upgrade ant ivy library
+ [NUTCH-2672] - Ant build erronously installs *-test.jar instead *.jar for target "nightly"
+ [NUTCH-2805] - Rename plugin urlfilter-domainblacklist
+ [NUTCH-2809] - Upgrade any23 plugin dependency to 2.4
+ [NUTCH-2816] - Add Spotbugs target to ant build
+ [NUTCH-2817] - Avoid check for equality of URL path and file part using ==/!=
+ [NUTCH-2829] - Fix ant target "clean-cache"
+
+Bug
+
+ [NUTCH-2669] - Reliable solution for javax.ws packaging.type
+ [NUTCH-2697] - Upgrade Ivy to fix the issue of an unset packaging.type property
+ [NUTCH-2801] - RobotsRulesParser command-line checker to use http.robots.agents as fall-back
+ [NUTCH-2810] - FreeGenerator to actually apply configured number of fetch lists
+ [NUTCH-2813] - MoreIndexingFilter - can't parse erroneous date - 2019-07-03T10:28:14
+ [NUTCH-2814] - HttpDateFormat's internal time zone may change after parsing a date
+ [NUTCH-2818] - Ant build: upgrade Apache Rat report task
+ [NUTCH-2823] - IllegalStateException in IndexWriters.describe() when validating url param for SolrIndexer
+ [NUTCH-2824] - urlnormalizer-basic to unescape percent-encoded host names
+
+Improvement
+
+ [NUTCH-1190] - MoreIndexingFilter refactor: move data formats used to parse "lastModified" to a config file.
+ [NUTCH-2582] - Set pool size of XML SAX parsers used for MIME detection in Tika 1.19
+ [NUTCH-2730] - SitemapProcessor to treat sitemap URLs as Set instead of List
+ [NUTCH-2782] - protocol-http / lib-http: support TLSv1.3
+ [NUTCH-2796] - Upgrade to crawler-commons 1.1
+ [NUTCH-2799] - Add .asf.yaml file
+ [NUTCH-2833] - Upgrade to Tika 1.25
+ [NUTCH-2835] - Upgrade commons-jexl from 2 --> 3
+ [NUTCH-2836] - Upgrade various commons dependencies
+ [NUTCH-2837] - Update multiple dependencies
+ [NUTCH-2841] - Upgrade xercesImpl dependency
+
+Wish
+
+ [NUTCH-2834] - Deduplication mode via command line in crawl script
+
+Task
+
+ [NUTCH-2830] - Upgrade any23 to v2.4
+
Nutch 1.17 Release 18/06/2020 (dd/mm/yyyy)
Release Report: https://s.apache.org/ovhry
diff --git a/NOTICE.txt b/NOTICE.txt
index 71f29fa..1c9efd0 100644
--- a/NOTICE.txt
+++ b/NOTICE.txt
@@ -1,5 +1,5 @@
Apache Nutch
-Copyright 2020 The Apache Software Foundation
+Copyright 2021 The Apache Software Foundation
This product includes software developed by The Apache Software
Foundation (http://www.apache.org/).
diff --git a/conf/nutch-default.xml b/conf/nutch-default.xml
index 6932eb5..df6916b 100644
--- a/conf/nutch-default.xml
+++ b/conf/nutch-default.xml
@@ -164,7 +164,7 @@
<property>
<name>http.agent.version</name>
- <value>Nutch-1.18-SNAPSHOT</value>
+ <value>Nutch-1.18</value>
<description>A version string to advertise in the User-Agent
header.</description>
</property>
diff --git a/default.properties b/default.properties
index e4b9619..fdb35b9 100644
--- a/default.properties
+++ b/default.properties
@@ -14,9 +14,9 @@
# limitations under the License.
name=apache-nutch
-version=1.18-SNAPSHOT
+version=1.18
final.name=${name}-${version}
-year=2020
+year=2021
basedir = ./
src.dir = ./src/java
diff --git a/src/bin/nutch b/src/bin/nutch
index 7d0d8ee..c501ea5 100755
--- a/src/bin/nutch
+++ b/src/bin/nutch
@@ -60,7 +60,7 @@ done
# if no args specified, show usage
if [ $# = 0 ]; then
- echo "nutch 1.18-SNAPSHOT"
+ echo "nutch 1.18"
echo "Usage: nutch COMMAND [-Dproperty=value]... [command-specific args]..."
echo "where COMMAND is one of:"
echo " readdb read / dump crawl db"