You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Sebastian Schelter (Created) (JIRA)" <ji...@apache.org> on 2011/11/09 12:14:51 UTC

[jira] [Created] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Remove all graph algorithms with the exception of PageRank
----------------------------------------------------------

                 Key: MAHOUT-879
                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
             Project: Mahout
          Issue Type: Task
          Components: Graph
    Affects Versions: 0.6
            Reporter: Sebastian Schelter
            Assignee: Sebastian Schelter


As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.

I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149358#comment-13149358 ] 

Hudson commented on MAHOUT-879:
-------------------------------

Integrated in Mahout-Quality #1175 (See [https://builds.apache.org/job/Mahout-Quality/1175/])
    MAHOUT-879 Remove all graph algorithms with the exception of PageRank
MAHOUT-879 Remove all graph algorithms with the exception of PageRank
MAHOUT-879 Remove all graph algorithms with the exception of PageRank
MAHOUT-879 Remove all graph algorithms with the exception of PageRank

ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201462
Files : 
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalk.java

ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201459
Files : 
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/SortableIndex.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/VectorElementWritable.java

ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201458
Files : 
* /mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/common/IntPairWritable.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing/AdjacencyMatrixJobTest.java

ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201457
Files : 
* /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/TasteHadoopUtils.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/als/ALSUtils.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/preparation/PreparePreferenceMatrixJob.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/common/HadoopUtil.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/common/IntPairWritable.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/AdjacencyMatrixJob.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/common
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/PageRankJob.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalk.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/linkanalysis/RandomWalkWithRestartJob.java
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/model
* /mahout/trunk/core/src/main/java/org/apache/mahout/graph/preprocessing
* /mahout/trunk/core/src/test/java/org/apache/mahout/cf/taste/hadoop/als/ParallelALSFactorizationJobTest.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/GraphTestCase.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/common
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/linkanalysis/PageRankJobTest.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/linkanalysis/RandomWalkWithRestartJobTest.java
* /mahout/trunk/core/src/test/java/org/apache/mahout/graph/preprocessing
* /mahout/trunk/core/src/test/java/org/apache/mahout/math/hadoop/MathHelper.java
* /mahout/trunk/src/conf/driver.classes.props
* /mahout/trunk/src/conf/pagerank.props
* /mahout/trunk/src/conf/randomwalkwithrestart.props

                
> Remove all graph algorithms with the exception of PageRank
> ----------------------------------------------------------
>
>                 Key: MAHOUT-879
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
>             Project: Mahout
>          Issue Type: Task
>          Components: Graph
>    Affects Versions: 0.6
>            Reporter: Sebastian Schelter
>            Assignee: Sebastian Schelter
>             Fix For: 0.6
>
>         Attachments: MAHOUT-879.patch, graph-processing.tar.gz
>
>
> As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.
> I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Posted by "Sebastian Schelter (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Schelter resolved MAHOUT-879.
---------------------------------------

       Resolution: Fixed
    Fix Version/s: 0.6
    
> Remove all graph algorithms with the exception of PageRank
> ----------------------------------------------------------
>
>                 Key: MAHOUT-879
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
>             Project: Mahout
>          Issue Type: Task
>          Components: Graph
>    Affects Versions: 0.6
>            Reporter: Sebastian Schelter
>            Assignee: Sebastian Schelter
>             Fix For: 0.6
>
>         Attachments: MAHOUT-879.patch, graph-processing.tar.gz
>
>
> As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.
> I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Posted by "Daniel Xiaodan Zhou (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147260#comment-13147260 ] 

Daniel Xiaodan Zhou commented on MAHOUT-879:
--------------------------------------------

Should people then use JUNG or other libraries for graph algorithms, or those algorithms will be put into a new sub-project on Apache? Thanks.
                
> Remove all graph algorithms with the exception of PageRank
> ----------------------------------------------------------
>
>                 Key: MAHOUT-879
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
>             Project: Mahout
>          Issue Type: Task
>          Components: Graph
>    Affects Versions: 0.6
>            Reporter: Sebastian Schelter
>            Assignee: Sebastian Schelter
>
> As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.
> I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Posted by "Sebastian Schelter (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAHOUT-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147262#comment-13147262 ] 

Sebastian Schelter commented on MAHOUT-879:
-------------------------------------------

I think Apache Giraph http://incubator.apache.org/giraph/ provides a promising approach for large scale graph processing
                
> Remove all graph algorithms with the exception of PageRank
> ----------------------------------------------------------
>
>                 Key: MAHOUT-879
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
>             Project: Mahout
>          Issue Type: Task
>          Components: Graph
>    Affects Versions: 0.6
>            Reporter: Sebastian Schelter
>            Assignee: Sebastian Schelter
>
> As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.
> I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Posted by "Sebastian Schelter (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Schelter updated MAHOUT-879:
--------------------------------------

    Attachment: MAHOUT-879.patch
    
> Remove all graph algorithms with the exception of PageRank
> ----------------------------------------------------------
>
>                 Key: MAHOUT-879
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
>             Project: Mahout
>          Issue Type: Task
>          Components: Graph
>    Affects Versions: 0.6
>            Reporter: Sebastian Schelter
>            Assignee: Sebastian Schelter
>             Fix For: 0.6
>
>         Attachments: MAHOUT-879.patch, graph-processing.tar.gz
>
>
> As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.
> I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAHOUT-879) Remove all graph algorithms with the exception of PageRank

Posted by "Sebastian Schelter (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAHOUT-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Schelter updated MAHOUT-879:
--------------------------------------

    Attachment: graph-processing.tar.gz

attached tar.gz file containing the removed graph algorithm implementations
                
> Remove all graph algorithms with the exception of PageRank
> ----------------------------------------------------------
>
>                 Key: MAHOUT-879
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-879
>             Project: Mahout
>          Issue Type: Task
>          Components: Graph
>    Affects Versions: 0.6
>            Reporter: Sebastian Schelter
>            Assignee: Sebastian Schelter
>             Fix For: 0.6
>
>         Attachments: MAHOUT-879.patch, graph-processing.tar.gz
>
>
> As discussed on the mailinglist we will remove the graph algorithms from Mahout (except PageRank). It has become pretty clear that the Map/Reduce is not suitable for most "classic" graph algorithms.
> I will attach a file containing the code of all algorithms that will be removed so that they don't get lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira