You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by Lin Yang <li...@gmail.com> on 2013/06/07 04:02:58 UTC

What is the best way to build and debug MR application?

Hi，dear friends,

I have setup a Hadoop cluster with 3 nodes in a local LAN, and now I would
like to develop some applications on it.

However, I'm not sure whether could I build the application on my laptop
which OS is windows 7 and deliver it to the remote Hadoop cluster by using
Eclipse plugin?

If not, what is the best way to develop Hadoop apps? should I install a
Ubuntu OS and setup a standalone Hadoop on my laptop in order to build and
debug my code?

Any suggestions would be appreciated.

-- 
Lin Yang

Re: What is the best way to build and debug MR application?

Posted by Lin Yang <li...@gmail.com>.

Hey, Sandy,

Thanks for your advice.


2013/6/7 Sandy Ryza <sa...@cloudera.com>

> (and running them from Eclipse)
>
>
> On Thu, Jun 6, 2013 at 7:21 PM, Sandy Ryza <sa...@cloudera.com>wrote:
>
>> Hi Lin,
>>
>> This is by no means a comprehensive answer to your question, but I've
>> found that I'm able to iterate fastest by writing unit tests using MRUnit (
>> http://mrunit.apache.org/)
>>
>> -Sandy
>>
>>
>> On Thu, Jun 6, 2013 at 7:02 PM, Lin Yang <li...@gmail.com>wrote:
>>
>>> Hi，dear friends,
>>>
>>> I have setup a Hadoop cluster with 3 nodes in a local LAN, and now I
>>> would like to develop some applications on it.
>>>
>>> However, I'm not sure whether could I build the application on my laptop
>>> which OS is windows 7 and deliver it to the remote Hadoop cluster by using
>>> Eclipse plugin?
>>>
>>> If not, what is the best way to develop Hadoop apps? should I install a
>>> Ubuntu OS and setup a standalone Hadoop on my laptop in order to build and
>>> debug my code?
>>>
>>> Any suggestions would be appreciated.
>>>
>>> --
>>> Lin Yang
>>>
>>
>>
>


-- 
Lin Yang

Re: What is the best way to build and debug MR application?

Posted by Lin Yang <li...@gmail.com>.

Hey, Sandy,

Thanks for your advice.


2013/6/7 Sandy Ryza <sa...@cloudera.com>

> (and running them from Eclipse)
>
>
> On Thu, Jun 6, 2013 at 7:21 PM, Sandy Ryza <sa...@cloudera.com>wrote:
>
>> Hi Lin,
>>
>> This is by no means a comprehensive answer to your question, but I've
>> found that I'm able to iterate fastest by writing unit tests using MRUnit (
>> http://mrunit.apache.org/)
>>
>> -Sandy
>>
>>
>> On Thu, Jun 6, 2013 at 7:02 PM, Lin Yang <li...@gmail.com>wrote:
>>
>>> Hi，dear friends,
>>>
>>> I have setup a Hadoop cluster with 3 nodes in a local LAN, and now I
>>> would like to develop some applications on it.
>>>
>>> However, I'm not sure whether could I build the application on my laptop
>>> which OS is windows 7 and deliver it to the remote Hadoop cluster by using
>>> Eclipse plugin?
>>>
>>> If not, what is the best way to develop Hadoop apps? should I install a
>>> Ubuntu OS and setup a standalone Hadoop on my laptop in order to build and
>>> debug my code?
>>>
>>> Any suggestions would be appreciated.
>>>
>>> --
>>> Lin Yang
>>>
>>
>>
>


-- 
Lin Yang

Re: What is the best way to build and debug MR application?

Posted by Lin Yang <li...@gmail.com>.

Hey, Sandy,

Thanks for your advice.


2013/6/7 Sandy Ryza <sa...@cloudera.com>

> (and running them from Eclipse)
>
>
> On Thu, Jun 6, 2013 at 7:21 PM, Sandy Ryza <sa...@cloudera.com>wrote:
>
>> Hi Lin,
>>
>> This is by no means a comprehensive answer to your question, but I've
>> found that I'm able to iterate fastest by writing unit tests using MRUnit (
>> http://mrunit.apache.org/)
>>
>> -Sandy
>>
>>
>> On Thu, Jun 6, 2013 at 7:02 PM, Lin Yang <li...@gmail.com>wrote:
>>
>>> Hi，dear friends,
>>>
>>> I have setup a Hadoop cluster with 3 nodes in a local LAN, and now I
>>> would like to develop some applications on it.
>>>
>>> However, I'm not sure whether could I build the application on my laptop
>>> which OS is windows 7 and deliver it to the remote Hadoop cluster by using
>>> Eclipse plugin?
>>>
>>> If not, what is the best way to develop Hadoop apps? should I install a
>>> Ubuntu OS and setup a standalone Hadoop on my laptop in order to build and
>>> debug my code?
>>>
>>> Any suggestions would be appreciated.
>>>
>>> --
>>> Lin Yang
>>>
>>
>>
>


-- 
Lin Yang