You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Huw Evans <ja...@yahoo.co.uk> on 2009/04/29 17:12:07 UTC
Hadoop Language Binding
Hi everyone,
I am interested in understanding how the language bindings
work in Hadoop and how I might contribute some. As Hadoop is built in Java, Java is the natural language to interface to it. However, I am interested in interfacing from other languages. My Hadoop back-end installation would remain the same, but the code I write that uses it would be built in a non-Java language. If you have any information on how I might approach this, please let me know.
Can anyone give me
some initial help on this, where to look in the codebase and some
pointers to any documents?
Thanks.
Huw Evans
Test directory structure is Refactored
Posted by Sharad Agarwal <sh...@yahoo-inc.com>.
After the commit of HADOOP-5135 (Separate the core, hdfs and mapred
junit tests), the directory structure of src/test has changed. Folder
src/test/org has been removed. All patches which touches a test case or
add a new one, need to refactor their patches as per the new structure.
- Sharad
Re: Hadoop Language Binding
Posted by Steve Loughran <st...@apache.org>.
I think some script language bindings would be nice. Java6 has
JavaScript out the box, for examples and testing, but with the right
JARs you could do mappers and reducers in-VM in Jython, JRuby, groovy, etc.
Re: Hadoop Language Binding
Posted by Wang Zhong <wa...@gmail.com>.
Hi
You can read Hadoop Streaming in Hadoop Documentation which allows
running MapReduce with any executable. The mappers and reducers get
input from stdin and output to stdout.
On Wed, Apr 29, 2009 at 11:12 PM, Huw Evans <ja...@yahoo.co.uk> wrote:
> Hi everyone,
>
> I am interested in understanding how the language bindings
> work in Hadoop and how I might contribute some. As Hadoop is built in Java, Java is the natural language to interface to it. However, I am interested in interfacing from other languages. My Hadoop back-end installation would remain the same, but the code I write that uses it would be built in a non-Java language. If you have any information on how I might approach this, please let me know.
>
> Can anyone give me
> some initial help on this, where to look in the codebase and some
> pointers to any documents?
>
> Thanks.
> Huw Evans
>
>
>
>
--
Wang Zhong