Hadoop post-1.0 plans?

[Jared Dunne <ja...@gmail.com>]

Hi-

I am a big fan of Lucene and sub projects and got a great taste of what
Hadoop has to offer for Java developers at my last position.

Is there any future work being considered for porting Hadoop to C with
Ruby/Perl bindings similar to what Lucy is for Lucene? I would love to be
able to use Hadoop from Ruby.. [I have read about Starfish, but it seems to
be missing some things (namely distributed reduce jobs).]

Jared-

Re: Hadoop post-1.0 plans?

[Andrew McNabb <am...@mcnabbs.org>]

On Tue, Jan 30, 2007 at 07:03:17AM -0800, Lee wrote:
> Are you aware of the options for other languages to work with Hadoop
> already?  Hadoop streaming which can work with any language.  JRuby and
> Jython and any other Java VM language can be used.  I think the energy and
> time to port to C would be better spent elsewhere.

I use hadoop-streaming a lot, and I really like it, but it is a kludge.
It's a great kludge, but long-term, I think we would get much better
performance and flexibility with native libraries.  I'm a Python user,
so Ruby bindings wouldn't help much, but if there were a C library, I
could make things work.

Things work now, but it would be nice if we eventually had something
native.

Thanks.

-- 
Andrew McNabb
http://www.mcnabbs.org/andrew/
PGP Fingerprint: 8A17 B57C 6879 1863 DE55  8012 AB4D 6098 8826 6868

Re: Hadoop post-1.0 plans?

[Lee <le...@gmail.com>]

Are you aware of the options for other languages to work with Hadoop
already?  Hadoop streaming which can work with any language.  JRuby and
Jython and any other Java VM language can be used.  I think the energy and
time to port to C would be better spent elsewhere.

On 1/29/07, Jared Dunne <ja...@gmail.com> wrote:
>
> Hi-
>
> I am a big fan of Lucene and sub projects and got a great taste of what
> Hadoop has to offer for Java developers at my last position.
>
> Is there any future work being considered for porting Hadoop to C with
> Ruby/Perl bindings similar to what Lucy is for Lucene? I would love to be
> able to use Hadoop from Ruby.. [I have read about Starfish, but it seems
> to
> be missing some things (namely distributed reduce jobs).]
>
> Jared-
>
>