You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2007/04/12 07:56:32 UTC

[jira] Created: (HADOOP-1251) A method to get the InputSplit from a Mapper

A method to get the InputSplit from a Mapper
--------------------------------------------

                 Key: HADOOP-1251
                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
             Project: Hadoop
          Issue Type: New Feature
          Components: mapred
    Affects Versions: 0.12.3
            Reporter: Owen O'Malley
         Assigned To: Owen O'Malley
             Fix For: 0.13.0


I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1251:
----------------------------------

    Status: Patch Available  (was: Open)

Resubmit patch for automatic qa testing.

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch, get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1251:
----------------------------------

    Attachment: get-input-split.patch

This patch moves the getInputSplit from a static method on the TaskTracker to a non-static method on the Reporter. My intention is that getInputSplit will eventually move to the context method along with the rest of the Reporter methods.

This patch also removes the Reporter subclass in the record io testing that was reimplementing Reporter.NULL.

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch, get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1251:
----------------------------------

    Attachment: get-input-split.patch

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1251:
----------------------------------

    Status: Open  (was: Patch Available)

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch, get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12489366 ] 

Hadoop QA commented on HADOOP-1251:
-----------------------------------

Integrated in Hadoop-Nightly #60 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/60/)

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch, get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12489257 ] 

Hadoop QA commented on HADOOP-1251:
-----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12355652/get-input-split.patch applied and successfully tested against trunk revision r529410.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/54/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/54/console

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch, get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488285 ] 

Hadoop QA commented on HADOOP-1251:
-----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12355402/get-input-split.patch applied and successfully tested against trunk revision r527711.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/36/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/36/console

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1251:
----------------------------------

    Status: Patch Available  (was: Open)

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1251:
---------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this.  Thanks, Owen!

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch, get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1251) A method to get the InputSplit from a Mapper

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12489216 ] 

Doug Cutting commented on HADOOP-1251:
--------------------------------------

This method is not specific to TaskTracker, i.e., it should work fine with LocalRunner too, right?  So there ought to be a better place to put it.  JobConf?  JobClient?

> A method to get the InputSplit from a Mapper
> --------------------------------------------
>
>                 Key: HADOOP-1251
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1251
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: get-input-split.patch
>
>
> I need a way to get the InputSplit from a Mapper. This is effectively a stop gap until we get context objects and can fix this much better. *smile* I introduce a static method in the TaskTracker named getInputSplit() that returns the InputSplit.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.