You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Eyal Golan <eg...@gmail.com> on 2011/12/26 11:12:29 UTC

Hadoop with Spring / Guice

Hi everyone,
This is my first post in this list, as I am a newb with Hadoop.
I am looking in the web for some documentation and example on how to use DI
framework with Hadoop.

Basically I want to have the mapping / reducing logic outside the mapper /
reducer classes.

I did a small prototype to show POC ofr our project.
In the prototype I had classes with static methods that did the mapping /
reducing logic.
this is not my preferable way of course.

So,
Are there any recommendations for good DI in Hadoop documentation?

Thanks,

Eyal


Eyal Golan
egolan74@gmail.com

Visit: http://jvdrums.sourceforge.net/
LinkedIn: http://www.linkedin.com/in/egolan74
Skype: egolan74

P  Save a tree. Please don't print this e-mail unless it's really necessary

Re: Hadoop with Spring / Guice

Posted by Owen O'Malley <ow...@hortonworks.com>.
Using guice in your MapReduce task is easy. Just create the injector in the
configure/setup method and include the jars in the distributed cache.

-- Owen

On Dec 27, 2011, at 4:01 PM, Eyal Golan <eg...@gmail.com> wrote:

Thanks.
I did see it before.
Will check it a little bit more.


Eyal Golan
egolan74@gmail.com

Visit: http://jvdrums.sourceforge.net/
LinkedIn: http://www.linkedin.com/in/egolan74
Skype: egolan74

P  Save a tree. Please don't print this e-mail unless it's really necessary



On Tue, Dec 27, 2011 at 2:04 AM, Mahadev Konar <ma...@hortonworks.com>wrote:

> Eyal,
>  Did you check out the spring data project?
>
>  http://www.springsource.org/spring-data/hadoop
>
>  That might offer some help.
>
> thanks
> mahadev
>
>
> On Mon, Dec 26, 2011 at 2:12 AM, Eyal Golan <eg...@gmail.com> wrote:
>
>> Hi everyone,
>> This is my first post in this list, as I am a newb with Hadoop.
>> I am looking in the web for some documentation and example on how to use
>> DI framework with Hadoop.
>>
>> Basically I want to have the mapping / reducing logic outside the mapper
>> / reducer classes.
>>
>> I did a small prototype to show POC ofr our project.
>> In the prototype I had classes with static methods that did the mapping /
>> reducing logic.
>> this is not my preferable way of course.
>>
>> So,
>> Are there any recommendations for good DI in Hadoop documentation?
>>
>> Thanks,
>>
>> Eyal
>>
>>
>> Eyal Golan
>> egolan74@gmail.com
>>
>> Visit: http://jvdrums.sourceforge.net/
>> LinkedIn: http://www.linkedin.com/in/egolan74
>> Skype: egolan74
>>
>> P  Save a tree. Please don't print this e-mail unless it's really
>> necessary
>>
>>
>

Re: Hadoop with Spring / Guice

Posted by Eyal Golan <eg...@gmail.com>.
Thanks.
I did see it before.
Will check it a little bit more.


Eyal Golan
egolan74@gmail.com

Visit: http://jvdrums.sourceforge.net/
LinkedIn: http://www.linkedin.com/in/egolan74
Skype: egolan74

P  Save a tree. Please don't print this e-mail unless it's really necessary



On Tue, Dec 27, 2011 at 2:04 AM, Mahadev Konar <ma...@hortonworks.com>wrote:

> Eyal,
>  Did you check out the spring data project?
>
>  http://www.springsource.org/spring-data/hadoop
>
>  That might offer some help.
>
> thanks
> mahadev
>
>
> On Mon, Dec 26, 2011 at 2:12 AM, Eyal Golan <eg...@gmail.com> wrote:
>
>> Hi everyone,
>> This is my first post in this list, as I am a newb with Hadoop.
>> I am looking in the web for some documentation and example on how to use
>> DI framework with Hadoop.
>>
>> Basically I want to have the mapping / reducing logic outside the mapper
>> / reducer classes.
>>
>> I did a small prototype to show POC ofr our project.
>> In the prototype I had classes with static methods that did the mapping /
>> reducing logic.
>> this is not my preferable way of course.
>>
>> So,
>> Are there any recommendations for good DI in Hadoop documentation?
>>
>> Thanks,
>>
>> Eyal
>>
>>
>> Eyal Golan
>> egolan74@gmail.com
>>
>> Visit: http://jvdrums.sourceforge.net/
>> LinkedIn: http://www.linkedin.com/in/egolan74
>> Skype: egolan74
>>
>> P  Save a tree. Please don't print this e-mail unless it's really
>> necessary
>>
>>
>

Re: Hadoop with Spring / Guice

Posted by Mahadev Konar <ma...@hortonworks.com>.
Eyal,
 Did you check out the spring data project?

 http://www.springsource.org/spring-data/hadoop

 That might offer some help.

thanks
mahadev

On Mon, Dec 26, 2011 at 2:12 AM, Eyal Golan <eg...@gmail.com> wrote:

> Hi everyone,
> This is my first post in this list, as I am a newb with Hadoop.
> I am looking in the web for some documentation and example on how to use
> DI framework with Hadoop.
>
> Basically I want to have the mapping / reducing logic outside the mapper /
> reducer classes.
>
> I did a small prototype to show POC ofr our project.
> In the prototype I had classes with static methods that did the mapping /
> reducing logic.
> this is not my preferable way of course.
>
> So,
> Are there any recommendations for good DI in Hadoop documentation?
>
> Thanks,
>
> Eyal
>
>
> Eyal Golan
> egolan74@gmail.com
>
> Visit: http://jvdrums.sourceforge.net/
> LinkedIn: http://www.linkedin.com/in/egolan74
> Skype: egolan74
>
> P  Save a tree. Please don't print this e-mail unless it's really necessary
>
>