You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@giraph.apache.org by "Claudio Martella (JIRA)" <ji...@apache.org> on 2013/02/13 17:48:12 UTC

[jira] [Updated] (GIRAPH-513) OnDiskPartitionStore should take advantage of multiple disks

     [ https://issues.apache.org/jira/browse/GIRAPH-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claudio Martella updated GIRAPH-513:
------------------------------------

    Attachment: GIRAPH-513.diff

passes mvn verify. Tested on cluster.
Had to do some trick with murmurhash as we have already hashing the partitions around across the workers.
                
> OnDiskPartitionStore should take advantage of multiple disks
> ------------------------------------------------------------
>
>                 Key: GIRAPH-513
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-513
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Claudio Martella
>            Assignee: Claudio Martella
>            Priority: Minor
>         Attachments: GIRAPH-513.diff
>
>
> Currently multiple compute threads can share the same OnDiskPartitionStore, but we do not take advantage of machines with multiple disks. We should partition the Partitions across the different disks, mimicking the way DataNodes take advantage of multiple disks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira