You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2010/03/03 18:40:27 UTC
[jira] Commented: (MAPREDUCE-1555) Maybe some code of MapTask is
wrong.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840751#action_12840751 ]
Arun C Murthy commented on MAPREDUCE-1555:
------------------------------------------
Ruyue - this is poorly documented, but mostly right. If I remember right, this was done so that the MapTask object in JobTracker doesn't have a reference to the input-split. This will not cause a problem because a single MapTask object on the JobTracker is never re-used i.e. a new one is created, serialized to the TaskTracker during scheduling and it's splitMetaInfo is never needed again.
> Maybe some code of MapTask is wrong.
> ------------------------------------
>
> Key: MAPREDUCE-1555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: task
> Reporter: Ruyue Ma
>
> {code:title=MapTask.java|borderStyle=solid}
> public void write(DataOutput out) throws IOException {
> super.write(out);
> if (isMapOrReduce()) {
> splitMetaInfo.write(out);
> splitMetaInfo = null; // HERE: why set null ??????
> }
> }
> {code}
> In above code, if the splitMetaInfo is set null, Second Serialization (will invoke write) will throw NullPointerException.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.