Want to contribute to this project

[Ben Kucinich <be...@gmail.com>]

I am interested in this project as I have done a lot of AI programming in
Java. I have used Hadoop but I have never programmed in it. Therefore, my
questions are:-

1. Is the knowledge of Hadoop necessary to contribute to this project?

2. Is there any scope for including graph search and path finding algorithms
related to graph. If you need contributors for graph theory, I would like to
contribute by writing utils classes for Graph search and finding problems.

3. Is there a list anywhere in the wiki where I can see what algorithms and
classes have to be written? Can I add the graph classes I have thought of in
this.

Please answer question 1. If graph classes are not required, please tell me
frankly so that I can think of other ways to contribute.

Re: Want to contribute to this project

[Grant Ingersoll <gs...@apache.org>]

On Feb 3, 2008, at 11:16 AM, Karl Wettin wrote:

>>
>> I don't know that it is initially, but it is definitely one of the  
>> ways we intend to scale.  That being said, my guess is that if you  
>> understand the complexities of programming ML algorithms, learning  
>> Hadoop won't be too difficult.
>
> I think we shold welcome all contributions related to ML. Someone  
> with MR experience and interest of a patch can pick up from there.  
> And until then they could get to live in some non scalable  
> contribution package. I'm all for more ASL:ed code.
>

+1.  We can always work on non-hadoop code to make it Hadoop, if that  
is what will work best.

-Grant

Re: Want to contribute to this project

[Karl Wettin <ka...@gmail.com>]

3 feb 2008 kl. 16.28 skrev Grant Ingersoll:

>
> On Feb 3, 2008, at 12:49 AM, Ben Kucinich wrote:
>
>> I am interested in this project as I have done a lot of AI  
>> programming in
>> Java. I have used Hadoop but I have never programmed in it.  
>> Therefore, my
>> questions are:-
>>
>> 1. Is the knowledge of Hadoop necessary to contribute to this  
>> project?
>
> I don't know that it is initially, but it is definitely one of the  
> ways we intend to scale.  That being said, my guess is that if you  
> understand the complexities of programming ML algorithms, learning  
> Hadoop won't be too difficult.

I think we shold welcome all contributions related to ML. Someone with  
MR experience and interest of a patch can pick up from there. And  
until then they could get to live in some non scalable contribution  
package. I'm all for more ASL:ed code.


   karl

Re: Want to contribute to this project

[Grant Ingersoll <gs...@apache.org>]

On Feb 3, 2008, at 12:49 AM, Ben Kucinich wrote:

> I am interested in this project as I have done a lot of AI  
> programming in
> Java. I have used Hadoop but I have never programmed in it.  
> Therefore, my
> questions are:-
>
> 1. Is the knowledge of Hadoop necessary to contribute to this project?

I don't know that it is initially, but it is definitely one of the  
ways we intend to scale.  That being said, my guess is that if you  
understand the complexities of programming ML algorithms, learning  
Hadoop won't be too difficult.

>
>
> 2. Is there any scope for including graph search and path finding  
> algorithms
> related to graph. If you need contributors for graph theory, I would  
> like to
> contribute by writing utils classes for Graph search and finding  
> problems.

What did you have in mind?  I have a personal interest in things like  
TextRank, etc.  Of course, these ranking ones can be thought of in  
matrix terms, too.

>
>
> 3. Is there a list anywhere in the wiki where I can see what  
> algorithms and
> classes have to be written? Can I add the graph classes I have  
> thought of in
> this.

Yep, they are all listed from the front page and some are being filled  
in, but feel free to add others.

>
>
> Please answer question 1. If graph classes are not required, please  
> tell me
> frankly so that I can think of other ways to contribute.

Re: Want to contribute to this project

[Karl Wettin <ka...@gmail.com>]

3 feb 2008 kl. 06.49 skrev Ben Kucinich:

> I am interested in this project as I have done a lot of AI  
> programming in
> Java. I have used Hadoop but I have never programmed in it.  
> Therefore, my
> questions are:-
>
>
> 1. Is the knowledge of Hadoop necessary to contribute to this project?

Absolutely not.

Yonik's Law of Patches says: A half-baked patch in Jira, with no  
documentation, no tests and no backwards compatibility is better than  
no patch at all.

> 2. Is there any scope for including graph search and path finding  
> algorithms
> related to graph. If you need contributors for graph theory, I would  
> like to
> contribute by writing utils classes for Graph search and finding  
> problems.

This is the first time someone mentions it on this forum. The semi- 
official short term goals is to implement a few of the classifiers  
(NB, NN, SVM) and clusterers (k-means, EM) algorithms in the paper <http://www.cs.stanford.edu/people/ang//papers/nips06-mapreducemulticore.pdf 
 >, but the project is in no way limited to this.

> 3. Is there a list anywhere in the wiki where I can see what  
> algorithms and
> classes have to be written? Can I add the graph classes I have  
> thought of in
> this.

The Stanford paper is our current guide, but it does not contain all  
the things we have been speaking of on this forum. Feature selection,  
HMM, Dijkstra and what not. I hope the Mahout Jira will be the Java  
community de facto place to post ML-related things, Hadooped or not.



   karl