You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2010/10/19 04:44:28 UTC

[jira] Commented: (MAPREDUCE-2141) Add an "extra data" field to Task for use by Mesos

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12922409#action_12922409 ] 

Owen O'Malley commented on MAPREDUCE-2141:
------------------------------------------

I'd suggest using either BytesWritable or Text rather than String. Other than that it looks good. Some additional JavaDoc that explained that the field was for the scheduler would be helpful too, I think.

> Add an "extra data" field to Task for use by Mesos
> --------------------------------------------------
>
>                 Key: MAPREDUCE-2141
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2141
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Matei Zaharia
>            Assignee: Matei Zaharia
>            Priority: Minor
>         Attachments: mapreduce-2141-v1.patch
>
>
> In order to support running Hadoop on the Mesos cluster manager (http://mesos.berkeley.edu/), I'd like to add an extra String field to the Task class to allow extra data (a Mesos task ID) to be associated with each task. This should have no impact on normal operation other than making the serialized form of Task a few bytes longer. In the Mesos support patch for Hadoop, this field is set by a pluggable Hadoop scheduler implementation to allow code on the TaskTracker side to see which Mesos task corresponds to each Hadoop task. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.