You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mrunit.apache.org by "Dave Beech (Updated) (JIRA)" <ji...@apache.org> on 2012/04/12 23:37:22 UTC

[jira] [Updated] (MRUNIT-97) Can't use MRunit if Context and DistributedCache class is used in mapreduce job

     [ https://issues.apache.org/jira/browse/MRUNIT-97?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dave Beech updated MRUNIT-97:
-----------------------------

    Attachment: MRUNIT-97.patch

Hi. I've created a patch which addresses the NullPointerException problem - it simply adds an extra stubbed method call on MockMapContextWrapper which returns an instance of MockInputSplit when getInputSplit() is called.  

This could be further extended - maybe you'd want to specify in your test what the file path / length of the input split should be? At the moment these values are hardcoded but this could easily be changed. 

As for testing DistributedCache, I think this would be more difficult since these are mostly static methods and cannot be mocked by Mockito. However, I believe there are other mocking frameworks that can do this (PowerMock for instance). Has anyone else got experience here?
                
> Can't use MRunit if Context and DistributedCache class is used in mapreduce job
> -------------------------------------------------------------------------------
>
>                 Key: MRUNIT-97
>                 URL: https://issues.apache.org/jira/browse/MRUNIT-97
>             Project: MRUnit
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Ajay Srivastava
>         Attachments: MRUNIT-97.patch
>
>
> I believe that you can't test input split filename and distributed cache at the moment.
> If you could file a JIRA on https://issues.apache.org/jira/browse/MRUNIT, I'm sure that someone would look on that sooner or later.
> Jarcec
> On Apr 11, 2012, at 7:53 AM, Ajay Srivastava wrote:
> Hi, 
> I am planning to use mrunit in one of the projects and written some test cases. These test cases run fine for simple map reduce jobs but give error for most of the others.
> For an example, in one of the map reduce job I have following code in setup method of Mapper class.
> context.getInputSplit()).getPath(); 
> I get null pointer exception at above statement.  Is there a way that I can set this context in test code ? If not, how can this kind of mrjobs be tested.
> Similarly we are using DistributedCache in some of our mr jobs. How can I test such jobs? Is there a mockup available for DistributedCache class in mrunit.
> Regards,
> Ajay Srivastava

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira