You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@giraph.apache.org by "Claudio Martella (JIRA)" <ji...@apache.org> on 2013/02/14 23:39:12 UTC

[jira] [Commented] (GIRAPH-514) DiskBackedMessageStores should take advantage of machines with multiple disks

    [ https://issues.apache.org/jira/browse/GIRAPH-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13578766#comment-13578766 ] 

Claudio Martella commented on GIRAPH-514:
-----------------------------------------

I have a patch for this one, will re-try it once GIRAPH-516 is in. By looking quickly at the code it appears to me that when we flush, we freeze new incoming messages. Can't we just spawn a thread to flush? That's how i was doing it at the beginning in my prototype.
                
> DiskBackedMessageStores should take advantage of machines with multiple disks
> -----------------------------------------------------------------------------
>
>                 Key: GIRAPH-514
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-514
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Claudio Martella
>            Assignee: Claudio Martella
>            Priority: Minor
>
> We are storing messages on a per partition on disk. We can store each file (partition data) on a different disk, if available, to take advantage of full IO bandwith, when using multiple compute threads or workers per machine.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira