You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Sebastian Nagel (JIRA)" <ji...@apache.org> on 2012/11/01 09:37:12 UTC
[jira] [Created] (NUTCH-1484) TableUtil unreverseURL fails on
file:// URLs
Sebastian Nagel created NUTCH-1484:
--------------------------------------
Summary: TableUtil unreverseURL fails on file:// URLs
Key: NUTCH-1484
URL: https://issues.apache.org/jira/browse/NUTCH-1484
Project: Nutch
Issue Type: Bug
Affects Versions: 2.1
Reporter: Sebastian Nagel
Priority: Critical
Fix For: 2.2
(reported by Rogério Pereira Araújo, see NUTCH-1483)
When crawling the local filesystem TableUtil.unreverseURL fails for URLs with empty host part (file:///Documents/). StringUtils.split(String, char) does not preserve empty parts which causes:
{code}
java.lang.ArrayIndexOutOfBoundsException: 1
at org.apache.nutch.util.TableUtil.unreverseUrl(TableUtil.java:98)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1484) TableUtil unreverseURL fails on
file:// URLs
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493820#comment-13493820 ]
Ferdy Galema commented on NUTCH-1484:
-------------------------------------
Hi,
I checked the patch (attached in NUTCH-1483 but I assume it is for this issue) and it makes perfect sense to fix it that way.
+1 for committing
> TableUtil unreverseURL fails on file:// URLs
> --------------------------------------------
>
> Key: NUTCH-1484
> URL: https://issues.apache.org/jira/browse/NUTCH-1484
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Reporter: Sebastian Nagel
> Priority: Critical
> Fix For: 2.2
>
>
> (reported by Rogério Pereira Araújo, see NUTCH-1483)
> When crawling the local filesystem TableUtil.unreverseURL fails for URLs with empty host part (file:///Documents/). StringUtils.split(String, char) does not preserve empty parts which causes:
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.nutch.util.TableUtil.unreverseUrl(TableUtil.java:98)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1484) TableUtil unreverseURL fails on
file:// URLs
Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493941#comment-13493941 ]
Lewis John McGibbney commented on NUTCH-1484:
---------------------------------------------
+1
> TableUtil unreverseURL fails on file:// URLs
> --------------------------------------------
>
> Key: NUTCH-1484
> URL: https://issues.apache.org/jira/browse/NUTCH-1484
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Reporter: Sebastian Nagel
> Priority: Critical
> Fix For: 2.2
>
>
> (reported by Rogério Pereira Araújo, see NUTCH-1483)
> When crawling the local filesystem TableUtil.unreverseURL fails for URLs with empty host part (file:///Documents/). StringUtils.split(String, char) does not preserve empty parts which causes:
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.nutch.util.TableUtil.unreverseUrl(TableUtil.java:98)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (NUTCH-1484) TableUtil unreverseURL fails on
file:// URLs
Posted by "Sebastian Nagel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Nagel resolved NUTCH-1484.
------------------------------------
Resolution: Fixed
Committed to 2.x (rev. 1408465)
> TableUtil unreverseURL fails on file:// URLs
> --------------------------------------------
>
> Key: NUTCH-1484
> URL: https://issues.apache.org/jira/browse/NUTCH-1484
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Reporter: Sebastian Nagel
> Priority: Critical
> Fix For: 2.2
>
> Attachments: NUTCH-1484.patch
>
>
> (reported by Rogério Pereira Araújo, see NUTCH-1483)
> When crawling the local filesystem TableUtil.unreverseURL fails for URLs with empty host part (file:///Documents/). StringUtils.split(String, char) does not preserve empty parts which causes:
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.nutch.util.TableUtil.unreverseUrl(TableUtil.java:98)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1484) TableUtil unreverseURL fails on
file:// URLs
Posted by "Sebastian Nagel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Nagel updated NUTCH-1484:
-----------------------------------
Attachment: NUTCH-1484.patch
Revised patch: replaced
StringUtils.splitByWholeSeparatorPreserveAllTokens(String str, String separator) by splitPreserveAllTokens(String str, char separator) which is significantly faster
(as fast as StringUtils.split(String, char)).
> TableUtil unreverseURL fails on file:// URLs
> --------------------------------------------
>
> Key: NUTCH-1484
> URL: https://issues.apache.org/jira/browse/NUTCH-1484
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Reporter: Sebastian Nagel
> Priority: Critical
> Fix For: 2.2
>
> Attachments: NUTCH-1484.patch
>
>
> (reported by Rogério Pereira Araújo, see NUTCH-1483)
> When crawling the local filesystem TableUtil.unreverseURL fails for URLs with empty host part (file:///Documents/). StringUtils.split(String, char) does not preserve empty parts which causes:
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.nutch.util.TableUtil.unreverseUrl(TableUtil.java:98)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (NUTCH-1484) TableUtil unreverseURL fails
on file:// URLs
Posted by "Sebastian Nagel (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494952#comment-13494952 ]
Sebastian Nagel edited comment on NUTCH-1484 at 11/11/12 7:56 PM:
------------------------------------------------------------------
Revised patch: replaced StringUtils.splitByWholeSeparatorPreserveAllTokens(String str, String separator) by splitPreserveAllTokens(String str, char separator) which is significantly faster (as fast as StringUtils.split(String, char)).
was (Author: wastl-nagel):
Revised patch: replaced
StringUtils.splitByWholeSeparatorPreserveAllTokens(String str, String separator) by splitPreserveAllTokens(String str, char separator) which is significantly faster
(as fast as StringUtils.split(String, char)).
> TableUtil unreverseURL fails on file:// URLs
> --------------------------------------------
>
> Key: NUTCH-1484
> URL: https://issues.apache.org/jira/browse/NUTCH-1484
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.1
> Reporter: Sebastian Nagel
> Priority: Critical
> Fix For: 2.2
>
> Attachments: NUTCH-1484.patch
>
>
> (reported by Rogério Pereira Araújo, see NUTCH-1483)
> When crawling the local filesystem TableUtil.unreverseURL fails for URLs with empty host part (file:///Documents/). StringUtils.split(String, char) does not preserve empty parts which causes:
> {code}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.nutch.util.TableUtil.unreverseUrl(TableUtil.java:98)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira