You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by unmesha sreeveni <un...@gmail.com> on 2013/11/25 05:31:49 UTC
Algorithms in Mahout
I have gone through http://mahout.apache.org for some data mining
algorithms already implemented on the Hadoop plattform.
>From that i understood that
1. Kmeans
2. Decision Tree
3. Navie Bayes
Have implementation in hadoop platform
And for
4. DBscan
5. k-mearesr neighbr
6. svm
7. Logistic Regression
8. Neural n/w
9. Aprori
it is not there in Mahout.
Is that inference right?
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: Algorithms in Mahout
Posted by ya...@gmail.com.
You can reference this:
https://cwiki.apache.org/confluence/display/MAHOUT/Algorithms
Most main stream data mining algorithm is implemented in mahout.
> �� 2013��11��25�գ�����12:31��unmesha sreeveni <un...@gmail.com> д����
>
> I have gone through http://mahout.apache.org for some data mining algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> Thanks & Regards
>
> Unmesha Sreeveni U.B
> Junior Developer
>
>
Re: Algorithms in Mahout
Posted by ya...@gmail.com.
You can reference this:
https://cwiki.apache.org/confluence/display/MAHOUT/Algorithms
Most main stream data mining algorithm is implemented in mahout.
> �� 2013��11��25�գ�����12:31��unmesha sreeveni <un...@gmail.com> д����
>
> I have gone through http://mahout.apache.org for some data mining algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> Thanks & Regards
>
> Unmesha Sreeveni U.B
> Junior Developer
>
>
Re: Algorithms in Mahout
Posted by Yexi Jiang <ye...@gmail.com>.
As far as I know:
4. *DBScan*: It has been proposed, but someone think it is not that useful.
5. *KNN*: there is a simple solution. Given an instance, suppose you want
to get its 3NN. In the mapper side, you can find the local 3NN at each
partition. At the reducer side, you can find the global 3NN.
6. *SVM*: I'm not sure whether there is an implementation in mahout.
7. *Logistic regression*: It is implemented as sgd in mahout.
8. *Neural network*: it is still under review.
9. *Frequent itemset*: There is fp-growth instead of apriori.
2013/11/24 unmesha sreeveni <un...@gmail.com>
> I have gone through http://mahout.apache.org for some data mining
> algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
------
Yexi Jiang,
ECS 251, yjian004@cs.fiu.edu
School of Computer and Information Science,
Florida International University
Homepage: http://users.cis.fiu.edu/~yjian004/
Re: Fwd: Algorithms in Mahout
Posted by unmesha sreeveni <un...@gmail.com>.
So currently we dnt have Decision Tree in mahout 0.6 release.
On Mon, Nov 25, 2013 at 2:59 PM, Sebastian Schelter <ssc.open@googlemail.com
> wrote:
> From the algorithms listed, only logistic regression (non-distributed)
> is implemented.
>
> Sorry, for the confusion, we are currently reworking the wiki.
>
> On 25.11.2013 10:24, Pavan K Narayanan wrote:
> > k nearest neibhor, svm, logistic regression, neural nets exist in mahout
> .
> > just type mahout and press enter you ll see list of algorithms available
> > and type mahout algo-name -h to get detailed information about how to use
> > /configure them
> >
> > Pavanc
> > On Nov 25, 2013 2:44 PM, "unmesha sreeveni" <un...@gmail.com>
> wrote:
> >
> >> I have gone through http://mahout.apache.org for some data mining
> >> algorithms already implemented on the Hadoop plattform.
> >>
> >> From that i understood that
> >>
> >> 1. Kmeans
> >> 2. Decision Tree
> >> 3. Navie Bayes
> >> Have implementation in hadoop platform
> >>
> >> And for
> >> 4. DBscan
> >> 5. k-mearesr neighbr
> >> 6. svm
> >> 7. Logistic Regression
> >> 8. Neural n/w
> >> 9. Aprori
> >> it is not there in Mahout.
> >> Is that inference right?
> >>
> >>
> >> --
> >> *Thanks & Regards*
> >>
> >> Unmesha Sreeveni U.B
> >>
> >> *Junior Developer*
> >>
> >
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: Fwd: Algorithms in Mahout
Posted by Sebastian Schelter <ss...@googlemail.com>.
>From the algorithms listed, only logistic regression (non-distributed)
is implemented.
Sorry, for the confusion, we are currently reworking the wiki.
On 25.11.2013 10:24, Pavan K Narayanan wrote:
> k nearest neibhor, svm, logistic regression, neural nets exist in mahout .
> just type mahout and press enter you ll see list of algorithms available
> and type mahout algo-name -h to get detailed information about how to use
> /configure them
>
> Pavanc
> On Nov 25, 2013 2:44 PM, "unmesha sreeveni" <un...@gmail.com> wrote:
>
>> I have gone through http://mahout.apache.org for some data mining
>> algorithms already implemented on the Hadoop plattform.
>>
>> From that i understood that
>>
>> 1. Kmeans
>> 2. Decision Tree
>> 3. Navie Bayes
>> Have implementation in hadoop platform
>>
>> And for
>> 4. DBscan
>> 5. k-mearesr neighbr
>> 6. svm
>> 7. Logistic Regression
>> 8. Neural n/w
>> 9. Aprori
>> it is not there in Mahout.
>> Is that inference right?
>>
>>
>> --
>> *Thanks & Regards*
>>
>> Unmesha Sreeveni U.B
>>
>> *Junior Developer*
>>
>
Re: Fwd: Algorithms in Mahout
Posted by Pavan K Narayanan <pa...@gmail.com>.
k nearest neibhor, svm, logistic regression, neural nets exist in mahout .
just type mahout and press enter you ll see list of algorithms available
and type mahout algo-name -h to get detailed information about how to use
/configure them
Pavan
On Nov 25, 2013 2:44 PM, "unmesha sreeveni" <un...@gmail.com> wrote:
> I have gone through http://mahout.apache.org for some data mining
> algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
Re: Algorithms in Mahout
Posted by unmesha sreeveni <un...@gmail.com>.
Thxs for the replies. I will go through those links.Thanks for spending
time for me :)
On Mon, Nov 25, 2013 at 11:59 PM, Suneel Marthi <su...@yahoo.com>wrote:
> Dhruv,
>
> Could u update the patch to present trunk codebase and also create a Wiki
> page for this?
>
>
>
>
>
> On Monday, November 25, 2013 1:04 PM, Dhruv <dh...@gmail.com> wrote:
>
> Distributed Hidden Markov Model trainer using Baum Welch Algorithm is also
> available as a patch. Please see the JIRA issue MAHOUT-627.
>
>
>
> On Mon, Nov 25, 2013 at 8:07 AM, Ted Dunning <te...@gmail.com>
> wrote:
>
> > On Mon, Nov 25, 2013 at 3:14 AM, Manuel Blechschmidt <
> > Manuel.Blechschmidt@gmx.de> wrote:
> >
> > > There are/were multiple kNN implementation in Mahout:
> > > Recommender knn
> > >
> >
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.mahout/mahout-core/0.6/org/apache/mahout/cf/taste/impl/recommender/knn/Optimizer.java(willberemoved for 0.9)
> > > stream knn
> > >
> >
> https://github.com/tdunning/knn/blob/master/src/main/java/org/apache/mahout/knn/cluster/StreamingKMeans.java
> > > normal knn
> > >
> >
> > Streaming k-means isn't strictly a knn implementation. It is a k-means
> > clustering application.
> >
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: Algorithms in Mahout
Posted by Suneel Marthi <su...@yahoo.com>.
Dhruv,
Could u update the patch to present trunk codebase and also create a Wiki page for this?
On Monday, November 25, 2013 1:04 PM, Dhruv <dh...@gmail.com> wrote:
Distributed Hidden Markov Model trainer using Baum Welch Algorithm is also
available as a patch. Please see the JIRA issue MAHOUT-627.
On Mon, Nov 25, 2013 at 8:07 AM, Ted Dunning <te...@gmail.com> wrote:
> On Mon, Nov 25, 2013 at 3:14 AM, Manuel Blechschmidt <
> Manuel.Blechschmidt@gmx.de> wrote:
>
> > There are/were multiple kNN implementation in Mahout:
> > Recommender knn
> >
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.mahout/mahout-core/0.6/org/apache/mahout/cf/taste/impl/recommender/knn/Optimizer.java(willbe removed for 0.9)
> > stream knn
> >
> https://github.com/tdunning/knn/blob/master/src/main/java/org/apache/mahout/knn/cluster/StreamingKMeans.java
> > normal knn
> >
>
> Streaming k-means isn't strictly a knn implementation. It is a k-means
> clustering application.
>
Re: Algorithms in Mahout
Posted by Dhruv <dh...@gmail.com>.
Distributed Hidden Markov Model trainer using Baum Welch Algorithm is also
available as a patch. Please see the JIRA issue MAHOUT-627.
On Mon, Nov 25, 2013 at 8:07 AM, Ted Dunning <te...@gmail.com> wrote:
> On Mon, Nov 25, 2013 at 3:14 AM, Manuel Blechschmidt <
> Manuel.Blechschmidt@gmx.de> wrote:
>
> > There are/were multiple kNN implementation in Mahout:
> > Recommender knn
> >
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.mahout/mahout-core/0.6/org/apache/mahout/cf/taste/impl/recommender/knn/Optimizer.java(willbe removed for 0.9)
> > stream knn
> >
> https://github.com/tdunning/knn/blob/master/src/main/java/org/apache/mahout/knn/cluster/StreamingKMeans.java
> > normal knn
> >
>
> Streaming k-means isn't strictly a knn implementation. It is a k-means
> clustering application.
>
Re: Algorithms in Mahout
Posted by Ted Dunning <te...@gmail.com>.
On Mon, Nov 25, 2013 at 3:14 AM, Manuel Blechschmidt <
Manuel.Blechschmidt@gmx.de> wrote:
> There are/were multiple kNN implementation in Mahout:
> Recommender knn
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.mahout/mahout-core/0.6/org/apache/mahout/cf/taste/impl/recommender/knn/Optimizer.java(will be removed for 0.9)
> stream knn
> https://github.com/tdunning/knn/blob/master/src/main/java/org/apache/mahout/knn/cluster/StreamingKMeans.java
> normal knn
>
Streaming k-means isn't strictly a knn implementation. It is a k-means
clustering application.
Re: Algorithms in Mahout
Posted by Manuel Blechschmidt <Ma...@gmx.de>.
Hi Unmesha,
please also consult JIRA as a source for algorithm, there you find implementations or discussions:
e.g. for neural networks a.k.a multilayer perceptrons:
https://issues.apache.org/jira/browse/MAHOUT-1265
https://issues.apache.org/jira/browse/MAHOUT-976
SVM:
https://issues.apache.org/jira/browse/MAHOUT-334
https://issues.apache.org/jira/browse/MAHOUT-232
https://issues.apache.org/jira/browse/MAHOUT-14
https://issues.apache.org/jira/browse/MAHOUT-227
For aprior Mahout offered an alternative Parallel Frequent Pattern Mining. This will be retired after 0.8
https://cwiki.apache.org/confluence/display/MAHOUT/Parallel+Frequent+Pattern+Mining
There are/were multiple kNN implementation in Mahout:
Recommender knn http://grepcode.com/file/repo1.maven.org/maven2/org.apache.mahout/mahout-core/0.6/org/apache/mahout/cf/taste/impl/recommender/knn/Optimizer.java (will be removed for 0.9)
stream knn https://github.com/tdunning/knn/blob/master/src/main/java/org/apache/mahout/knn/cluster/StreamingKMeans.java
normal knn
Hope that helps
Manuel
On 25.11.2013, at 10:14, unmesha sreeveni wrote:
> I have gone through http://mahout.apache.org for some data mining
> algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
--
Manuel Blechschmidt
Dortustr. 57
14467 Potsdam
Mobil: 0173/6322621
Twitter: http://twitter.com/Manuel_B
Fwd: Algorithms in Mahout
Posted by unmesha sreeveni <un...@gmail.com>.
I have gone through http://mahout.apache.org for some data mining
algorithms already implemented on the Hadoop plattform.
>From that i understood that
1. Kmeans
2. Decision Tree
3. Navie Bayes
Have implementation in hadoop platform
And for
4. DBscan
5. k-mearesr neighbr
6. svm
7. Logistic Regression
8. Neural n/w
9. Aprori
it is not there in Mahout.
Is that inference right?
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
Re: Algorithms in Mahout
Posted by ya...@gmail.com.
You can reference this:
https://cwiki.apache.org/confluence/display/MAHOUT/Algorithms
Most main stream data mining algorithm is implemented in mahout.
> 在 2013年11月25日，下午12:31，unmesha sreeveni <un...@gmail.com> 写道：
>
> I have gone through http://mahout.apache.org for some data mining algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> Thanks & Regards
>
> Unmesha Sreeveni U.B
> Junior Developer
>
>
Re: Algorithms in Mahout
Posted by Yexi Jiang <ye...@gmail.com>.
As far as I know:
4. *DBScan*: It has been proposed, but someone think it is not that useful.
5. *KNN*: there is a simple solution. Given an instance, suppose you want
to get its 3NN. In the mapper side, you can find the local 3NN at each
partition. At the reducer side, you can find the global 3NN.
6. *SVM*: I'm not sure whether there is an implementation in mahout.
7. *Logistic regression*: It is implemented as sgd in mahout.
8. *Neural network*: it is still under review.
9. *Frequent itemset*: There is fp-growth instead of apriori.
2013/11/24 unmesha sreeveni <un...@gmail.com>
> I have gone through http://mahout.apache.org for some data mining
> algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
------
Yexi Jiang,
ECS 251, yjian004@cs.fiu.edu
School of Computer and Information Science,
Florida International University
Homepage: http://users.cis.fiu.edu/~yjian004/
Re: Algorithms in Mahout
Posted by Yexi Jiang <ye...@gmail.com>.
As far as I know:
4. *DBScan*: It has been proposed, but someone think it is not that useful.
5. *KNN*: there is a simple solution. Given an instance, suppose you want
to get its 3NN. In the mapper side, you can find the local 3NN at each
partition. At the reducer side, you can find the global 3NN.
6. *SVM*: I'm not sure whether there is an implementation in mahout.
7. *Logistic regression*: It is implemented as sgd in mahout.
8. *Neural network*: it is still under review.
9. *Frequent itemset*: There is fp-growth instead of apriori.
2013/11/24 unmesha sreeveni <un...@gmail.com>
> I have gone through http://mahout.apache.org for some data mining
> algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
------
Yexi Jiang,
ECS 251, yjian004@cs.fiu.edu
School of Computer and Information Science,
Florida International University
Homepage: http://users.cis.fiu.edu/~yjian004/
Re: Algorithms in Mahout
Posted by Yexi Jiang <ye...@gmail.com>.
As far as I know:
4. *DBScan*: It has been proposed, but someone think it is not that useful.
5. *KNN*: there is a simple solution. Given an instance, suppose you want
to get its 3NN. In the mapper side, you can find the local 3NN at each
partition. At the reducer side, you can find the global 3NN.
6. *SVM*: I'm not sure whether there is an implementation in mahout.
7. *Logistic regression*: It is implemented as sgd in mahout.
8. *Neural network*: it is still under review.
9. *Frequent itemset*: There is fp-growth instead of apriori.
2013/11/24 unmesha sreeveni <un...@gmail.com>
> I have gone through http://mahout.apache.org for some data mining
> algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
>
>
--
------
Yexi Jiang,
ECS 251, yjian004@cs.fiu.edu
School of Computer and Information Science,
Florida International University
Homepage: http://users.cis.fiu.edu/~yjian004/
Re: Algorithms in Mahout
Posted by ya...@gmail.com.
You can reference this:
https://cwiki.apache.org/confluence/display/MAHOUT/Algorithms
Most main stream data mining algorithm is implemented in mahout.
> 在 2013年11月25日，下午12:31，unmesha sreeveni <un...@gmail.com> 写道：
>
> I have gone through http://mahout.apache.org for some data mining algorithms already implemented on the Hadoop plattform.
>
> From that i understood that
>
> 1. Kmeans
> 2. Decision Tree
> 3. Navie Bayes
> Have implementation in hadoop platform
>
> And for
> 4. DBscan
> 5. k-mearesr neighbr
> 6. svm
> 7. Logistic Regression
> 8. Neural n/w
> 9. Aprori
> it is not there in Mahout.
> Is that inference right?
>
> --
> Thanks & Regards
>
> Unmesha Sreeveni U.B
> Junior Developer
>
>