You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (JIRA)" <ji...@apache.org> on 2012/12/21 15:19:13 UTC
[jira] [Updated] (NUTCH-1509) Implement read/write in NutchField
[ https://issues.apache.org/jira/browse/NUTCH-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1509:
---------------------------------
Attachment: NUTCH-1509-1.7-1.patch
First patch. I'm getting a nasty NPE when reading an Object. I've made Writables before and have up to now no idea what i'm doing wrong.
{code}
java.lang.NullPointerException
at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:183)
at org.apache.hadoop.io.ObjectWritable.readFields(ObjectWritable.java:66)
at org.apache.nutch.indexer.NutchField.readFields(NutchField.java:80)
at org.apache.nutch.indexer.NutchDocument.readFields(NutchDocument.java:112)
at org.apache.nutch.indexer.NutchIndexAction.readFields(NutchIndexAction.java:50)
at org.apache.nutch.util.GenericWritableConfigurable.readFields(GenericWritableConfigurable.java:54)
at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:67)
at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:40)
at org.apache.hadoop.mapred.Task$ValuesIterator.readNextValue(Task.java:1282)
at org.apache.hadoop.mapred.Task$ValuesIterator.next(Task.java:1222)
at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.moveToNext(ReduceTask.java:250)
at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:246)
at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:40)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:520)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:421)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
{code}
Any ideas?
> Implement read/write in NutchField
> ----------------------------------
>
> Key: NUTCH-1509
> URL: https://issues.apache.org/jira/browse/NUTCH-1509
> Project: Nutch
> Issue Type: Bug
> Components: indexer
> Affects Versions: 1.6
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 1.7
>
> Attachments: NUTCH-1509-1.7-1.patch
>
>
> For some reason write() and readFields() in NutchField have not been implemented. Never assumed this could be true i wasted 30 minutes in finding out ;)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira