You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Dan Harvey (JIRA)" <ji...@apache.org> on 2011/05/30 19:14:47 UTC

[jira] [Created] (MAPREDUCE-2546) MRunit ReduceDriver does not fully replicate the reducers behaviour with reusing pointers over the iterator

MRunit ReduceDriver does not fully replicate the reducers behaviour with reusing pointers over the iterator
-----------------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-2546
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2546
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: contrib/mrunit
    Affects Versions: 0.21.0, 0.20.2, 0.20.1
            Reporter: Dan Harvey
            Priority: Minor


The MRunit ReduceDriver does not replicate the behaviour of re-using the pointer to the returned values as they are iterated over. This is a problem for testing as it does not fail when you are incorrectly storing this pointer for a value if you want to use it later on in the iteration over the values.

The behaviour should be modified so the iterator will return the same pointer every time.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2546) MRunit ReduceDriver does not fully replicate the reducers behaviour with reusing pointers over the iterator

Posted by "Dan Harvey (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041203#comment-13041203 ] 

Dan Harvey commented on MAPREDUCE-2546:
---------------------------------------

This was discussed in the mailing lists last year

http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-user/201012.mbox/%3CAANLkTinMDb9NLkNXYQg=8=aFBbQt7GNuZoVpk8+avcqj@mail.gmail.com%3E

We've got code for this we will clean up and submit as a patch as soon as we can.

> MRunit ReduceDriver does not fully replicate the reducers behaviour with reusing pointers over the iterator
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2546
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2546
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/mrunit
>    Affects Versions: 0.20.1, 0.20.2, 0.21.0
>            Reporter: Dan Harvey
>            Priority: Minor
>
> The MRunit ReduceDriver does not replicate the behaviour of re-using the pointer to the returned values as they are iterated over. This is a problem for testing as it does not fail when you are incorrectly storing this pointer for a value if you want to use it later on in the iteration over the values.
> The behaviour should be modified so the iterator will return the same pointer every time.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira