You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@giraph.apache.org by "Eli Reisman (JIRA)" <ji...@apache.org> on 2012/11/18 19:44:57 UTC

[jira] [Commented] (GIRAPH-426) Timeout during edge exchange for big datasets

    [ https://issues.apache.org/jira/browse/GIRAPH-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499872#comment-13499872 ] 

Eli Reisman commented on GIRAPH-426:
------------------------------------

The supernodes make life interesting, thats for sure. For appplications where trimming them is not an option, this will be "real life" for Giraph. Its great that you are evaluating performance and issues this way.
                
> Timeout during edge exchange for big datasets
> ---------------------------------------------
>
>                 Key: GIRAPH-426
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-426
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Alessandro Presta
>
> I'm seeing timeouts after all edge input splits are read from a dataset with 42B edges using 400 workers.
> We probably lack some progress() calls in the code that processes mutations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira