You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2007/03/11 07:35:09 UTC
[jira] Created: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Streaming, NPE when reading sequencefile
-----------------------------------------
Key: HADOOP-1109
URL: https://issues.apache.org/jira/browse/HADOOP-1109
Project: Hadoop
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.12.0, 0.11.2, 0.11.1, 0.11.0
Reporter: Koji Noguchi
When using StreamSequenceRecordReader, I get
java.lang.NullPointerException
at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1109:
----------------------------------
Status: Patch Available (was: Open)
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12480159 ]
Mahadev konar commented on HADOOP-1109:
---------------------------------------
this does not seem like the right way to fix it. The StreamInputFormat inherits from TextInputFormat and should not return a SequenceFileRecordReader. We really need to merge the code for record reader and inputformat in streaming and hadoop mainline.
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.11.0, 0.11.1, 0.11.2, 0.12.0
> Reporter: Koji Noguchi
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1109:
----------------------------------
Status: Patch Available (was: Open)
Sorry for the confusion. Koji had some concerns so, I moved it to not patch-available. This fix is certainly necessary.
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1109:
---------------------------------
Status: Patch Available (was: Open)
I'm not sure, but would this work?
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0, 0.11.2, 0.11.1, 0.11.0
> Reporter: Koji Noguchi
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12480550 ]
Tom White commented on HADOOP-1109:
-----------------------------------
Owen, I'm not sure if you are voting for this to be committed or for it to be solved following Mahadev's suggestion.
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1109:
---------------------------------
Attachment: 1109.patch
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.11.0, 0.11.1, 0.11.2, 0.12.0
> Reporter: Koji Noguchi
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1109:
----------------------------------
Fix Version/s: 0.12.1
Affects Version/s: (was: 0.11.2)
(was: 0.11.1)
(was: 0.11.0)
+1
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12480615 ]
Mahadev konar commented on HADOOP-1109:
---------------------------------------
take back my comments... the code already used to return a sequencefilerecordreader. We can cleanup the code to solve that problem later. +1 for applying the patch to fix the problem for now.
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-1109:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Koji!
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated HADOOP-1109:
---------------------------------
Status: Open (was: Patch Available)
sorry, I haven't uploaded the patch.
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0, 0.11.2, 0.11.1, 0.11.0
> Reporter: Koji Noguchi
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1109) Streaming, NPE when reading
sequencefile
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1109:
----------------------------------
Status: Open (was: Patch Available)
> Streaming, NPE when reading sequencefile
> -----------------------------------------
>
> Key: HADOOP-1109
> URL: https://issues.apache.org/jira/browse/HADOOP-1109
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.12.0
> Reporter: Koji Noguchi
> Fix For: 0.12.1
>
> Attachments: 1109.patch
>
>
> When using StreamSequenceRecordReader, I get
> java.lang.NullPointerException
> at org.apache.hadoop.streaming.StreamInputFormat.getRecordReader(StreamInputFormat.java:127)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:139)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.