You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (Created) (JIRA)" <ji...@apache.org> on 2011/12/15 14:48:30 UTC
[jira] [Created] (NUTCH-1226) Migrate CrawlDbReader to MapReduce
API
Migrate CrawlDbReader to MapReduce API
--------------------------------------
Key: NUTCH-1226
URL: https://issues.apache.org/jira/browse/NUTCH-1226
Project: Nutch
Issue Type: Sub-task
Reporter: Markus Jelsma
Assignee: Markus Jelsma
Priority: Minor
Fix For: 1.5
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce
API
Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1226:
---------------------------------
Description: Hadoop 0.21 only!
Patch Info: Patch Available
> Migrate CrawlDbReader to MapReduce API
> --------------------------------------
>
> Key: NUTCH-1226
> URL: https://issues.apache.org/jira/browse/NUTCH-1226
> Project: Nutch
> Issue Type: Sub-task
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
> Fix For: 1.5
>
> Attachments: NUTCH-1226-1.5-1.patch
>
>
> Hadoop 0.21 only!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce
API
Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1226:
---------------------------------
Attachment: NUTCH-1226-1.5-1.patch
First crack! Had a lot of trouble with some deprecated stuff and could not find it all. Only remaining issue is finding the sequencefile readers.
{code}
[javac] Compiling 1 source file to /home/markus/projects/apache/nutch/trunk/build/classes
[javac] /home/markus/projects/apache/nutch/trunk/src/java/org/apache/nutch/crawl/CrawlDbReader.java:312: cannot find symbol
[javac] symbol : method getReaders(org.apache.hadoop.fs.Path,org.apache.hadoop.conf.Configuration)
[javac] location: class org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat
[javac] SequenceFile.Reader[] readers = SequenceFileOutputFormat.getReaders(tmpFolder, conf);
[javac] ^
[javac] Note: /home/markus/projects/apache/nutch/trunk/src/java/org/apache/nutch/crawl/CrawlDbReader.java uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error
{code}
> Migrate CrawlDbReader to MapReduce API
> --------------------------------------
>
> Key: NUTCH-1226
> URL: https://issues.apache.org/jira/browse/NUTCH-1226
> Project: Nutch
> Issue Type: Sub-task
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
> Fix For: 1.5
>
> Attachments: NUTCH-1226-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce
API
Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1226:
---------------------------------
Fix Version/s: (was: 1.5)
1.6
20120304-push-1.6
> Migrate CrawlDbReader to MapReduce API
> --------------------------------------
>
> Key: NUTCH-1226
> URL: https://issues.apache.org/jira/browse/NUTCH-1226
> Project: Nutch
> Issue Type: Sub-task
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
> Fix For: 1.6
>
> Attachments: NUTCH-1226-1.5-1.patch
>
>
> Hadoop 0.21 only!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira