Debugging MR jobs using Eclipse

[Sh...@cognizant.com]

HI,

 

I want to debug my MR Job on Ubuntu machine using eclipse.

How can I do that, can anyone point me to the steps required?

 

Regards,

Shreya


This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.
Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful.

Re: Debugging MR jobs using Eclipse

[Harsh J <ha...@cloudera.com>]

There are a few options. Most of the times, using logging and a LocalJobRunner turns out to be the easiest way. There is also Apache MRUnit you can use to test your M/R code (which is a much better approach, IMO) - https://cwiki.apache.org/confluence/display/MRUNIT

Remote debugging of tasks is a fair bit tricker, and you'll spend more time setting that up and trying your luck than actually debugging that way :)

On 29-Dec-2011, at 10:46 AM, <Sh...@cognizant.com> <Sh...@cognizant.com> wrote:

> HI,
> 
> 
> 
> I want to debug my MR Job on Ubuntu machine using eclipse.
> 
> How can I do that, can anyone point me to the steps required?
> 
> 
> 
> Regards,
> 
> Shreya
> 
> 
> This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information.
> If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.
> Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful.