You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Rogério Pereira Araújo (JIRA)" <ji...@apache.org> on 2012/10/31 17:17:11 UTC
[jira] [Updated] (NUTCH-1483) Can't crawl filesystem with
protocol-file plugin
[ https://issues.apache.org/jira/browse/NUTCH-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rogério Pereira Araújo updated NUTCH-1483:
------------------------------------------
Description:
I tried to follow the same steps described in this wiki page:
http://wiki.apache.org/nutch/IntranetDocumentSearch
I made all required changes on regex-urlfilter.txt and added the following entry in my seed file:
file:///home/rogerio/Documents/
The permissions are ok, I'm running nutch in the same use as folder, so nutch has the required permissions, unfortunatelly I'm getting the following error:
org.apache.nutch.protocol.file.FileError: File Error: 404
at org.apache.nutch.protocol.file.File.getProtocolOutput(File.java:105)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:514)
fetch of file://home/rogerio/Documents/ failed with: org.apache.nutch.protocol.file.FileError: File Error: 404
Why the logs are showing file://home/rogerio/Documents/ instead of file:///home/rogerio/Documents/ ???
Note: The regex-urlfilter entry only works as expected if I add the entry
+^file://home/rogerio/Documents/ instead of +^file:///home/rogerio/Documents/ as wiki says.
was:
I tried to follow the same steps describe in this wiki page:
http://wiki.apache.org/nutch/IntranetDocumentSearch
I made all required changes on regex-urlfilter.txt and added the following entry in my seed file:
file:///home/rogerio/Documents/
The permissions are ok, I'm running nutch in the same use as folder, so nutch has the required permissions, unfortunatelly I'm getting the following error:
org.apache.nutch.protocol.file.FileError: File Error: 404
at org.apache.nutch.protocol.file.File.getProtocolOutput(File.java:105)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:514)
fetch of file://home/rogerio/Documents/ failed with: org.apache.nutch.protocol.file.FileError: File Error: 404
Why the logs are showing file://home/rogerio/Documents/ instead of file:///home/rogerio/Documents/ ???
Note: The regex-urlfilter entry only works as expected if I add the entry
+^file://home/rogerio/Documents/ instead of +^file:///home/rogerio/Documents/ as wiki says.
> Can't crawl filesystem with protocol-file plugin
> ------------------------------------------------
>
> Key: NUTCH-1483
> URL: https://issues.apache.org/jira/browse/NUTCH-1483
> Project: Nutch
> Issue Type: Bug
> Components: protocol
> Affects Versions: 2.1
> Environment: OpenSUSE 12.1, OpenJDK 1.6.0
> Reporter: Rogério Pereira Araújo
>
> I tried to follow the same steps described in this wiki page:
> http://wiki.apache.org/nutch/IntranetDocumentSearch
> I made all required changes on regex-urlfilter.txt and added the following entry in my seed file:
> file:///home/rogerio/Documents/
> The permissions are ok, I'm running nutch in the same use as folder, so nutch has the required permissions, unfortunatelly I'm getting the following error:
> org.apache.nutch.protocol.file.FileError: File Error: 404
> at org.apache.nutch.protocol.file.File.getProtocolOutput(File.java:105)
> at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:514)
> fetch of file://home/rogerio/Documents/ failed with: org.apache.nutch.protocol.file.FileError: File Error: 404
> Why the logs are showing file://home/rogerio/Documents/ instead of file:///home/rogerio/Documents/ ???
> Note: The regex-urlfilter entry only works as expected if I add the entry
> +^file://home/rogerio/Documents/ instead of +^file:///home/rogerio/Documents/ as wiki says.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira