You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Jakob Homan (JIRA)" <ji...@apache.org> on 2012/06/06 16:21:23 UTC

[jira] [Created] (GIRAPH-203) Provide sample graphs for playing around with

Jakob Homan created GIRAPH-203:
----------------------------------

             Summary: Provide sample graphs for playing around with
                 Key: GIRAPH-203
                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
             Project: Giraph
          Issue Type: Task
          Components: examples
            Reporter: Jakob Homan


It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.

We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (GIRAPH-203) Provide sample graphs for playing around with

Posted by "Brian Femiano (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291395#comment-13291395 ] 

Brian Femiano commented on GIRAPH-203:
--------------------------------------

I have some very simple edge list sets. 1mil, 100mil, and 1bil. 

They are custom generated using a tool I wrote. I used them to benchmark a few simple BSP algorithms. They have no contextual relevance to any actual domain problem.

I'd be happy to contribute. 


                
> Provide sample graphs for playing around with
> ---------------------------------------------
>
>                 Key: GIRAPH-203
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
>             Project: Giraph
>          Issue Type: Task
>          Components: examples
>            Reporter: Jakob Homan
>
> It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.
> We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (GIRAPH-203) Provide sample graphs for playing around with

Posted by "Eli Reisman (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464371#comment-13464371 ] 

Eli Reisman commented on GIRAPH-203:
------------------------------------

We also need to get GIRAPH-26 committed, it generates very realistic graph data for Giraph that possesses many of the properties of a social graph. We need to have a very mathy committer review the patch or alternately put up some unit tests for it etc. but its been run tested a fair amount and will be a really useful addition.
                
> Provide sample graphs for playing around with
> ---------------------------------------------
>
>                 Key: GIRAPH-203
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
>             Project: Giraph
>          Issue Type: Task
>          Components: examples
>            Reporter: Jakob Homan
>
> It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.
> We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (GIRAPH-203) Provide sample graphs for playing around with

Posted by "Dan Brickley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463935#comment-13463935 ] 

Dan Brickley commented on GIRAPH-203:
-------------------------------------

See also http://oai.cwi.nl/oai/asset/19919/19919D.pdf 'S3G2: a Scalable Structure-correlated Social Graph Generator.'
                
> Provide sample graphs for playing around with
> ---------------------------------------------
>
>                 Key: GIRAPH-203
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
>             Project: Giraph
>          Issue Type: Task
>          Components: examples
>            Reporter: Jakob Homan
>
> It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.
> We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (GIRAPH-203) Provide sample graphs for playing around with

Posted by "Eli Reisman (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397941#comment-13397941 ] 

Eli Reisman commented on GIRAPH-203:
------------------------------------

including some sample graphs of appropriate size for people to test on would be fantastic to me. Something included to generate more would be great too. This could encourage new users to test drive the performance of Giraph on their own clusters without any extra work on their part.

                
> Provide sample graphs for playing around with
> ---------------------------------------------
>
>                 Key: GIRAPH-203
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
>             Project: Giraph
>          Issue Type: Task
>          Components: examples
>            Reporter: Jakob Homan
>
> It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.
> We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (GIRAPH-203) Provide sample graphs for playing around with

Posted by "Claudio Martella (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290883#comment-13290883 ] 

Claudio Martella commented on GIRAPH-203:
-----------------------------------------

I welcome this proposal as this should also solve the problem we discussed yesterday of getting people started with giraph without the need of many IntIntIntIntVertex because we don't know on what graph they're going to test it.
                
> Provide sample graphs for playing around with
> ---------------------------------------------
>
>                 Key: GIRAPH-203
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
>             Project: Giraph
>          Issue Type: Task
>          Components: examples
>            Reporter: Jakob Homan
>
> It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.
> We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (GIRAPH-203) Provide sample graphs for playing around with

Posted by "Sebastian Schelter (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464232#comment-13464232 ] 

Sebastian Schelter commented on GIRAPH-203:
-------------------------------------------

A superb source of datasets is the 'Koblenz Network Collection' (konect) http://konect.uni-koblenz.de/ It would be great if someone provided means to make these graphs readable for Giraph.
                
> Provide sample graphs for playing around with
> ---------------------------------------------
>
>                 Key: GIRAPH-203
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-203
>             Project: Giraph
>          Issue Type: Task
>          Components: examples
>            Reporter: Jakob Homan
>
> It would be great to have a few graphs included with the distribution.  This would allow people to start running pagerank, etc. on actual networks and see results immediately.  Gephi has a good collection of networks with reasonable licenses: http://wiki.gephi.org/index.php/Datasets For instance, the Jazz Social Network and Marvel Heroes appear to have good licenses and are interesting real-life (as it were) social networks.
> We'd need to pick a few, convert them into Giraph-friendly format and verify they play nice with our algorithms.  This JIRA can serve as uberjira for other jiras to add each that's useful and appropriate.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira