You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hama.apache.org by "Suraj Menon (JIRA)" <ji...@apache.org> on 2012/12/15 23:14:12 UTC

[jira] [Updated] (HAMA-700) BSPPartitioner should be configurable to be optional and allow input format conversion

     [ https://issues.apache.org/jira/browse/HAMA-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suraj Menon updated HAMA-700:
-----------------------------

    Attachment: HAMA-700-v1.patch

This patch is just an implementation of the idea to convert the raw input format to the processing input format. This would be essential especially when we start integrating with HBase, Accumulo. Please vote on the idea. I would like to continue on the patch. I feel Thomas had some genuine concerns. We can use the VertexInputReader defined in the examples as they were and we can do runtime partitioning of graph in the PartitionRunner.
                
> BSPPartitioner should be configurable to be optional and allow input format conversion
> --------------------------------------------------------------------------------------
>
>                 Key: HAMA-700
>                 URL: https://issues.apache.org/jira/browse/HAMA-700
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>            Reporter: Suraj Menon
>            Assignee: Suraj Menon
>             Fix For: 0.6.1
>
>         Attachments: HAMA-700-v1.patch
>
>
> There should be a provisioning for skipping the PartitionRunner if needed. Also we can have a RecordConverter interface so that the PartitionRunner can read the input in any format and create new splits. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira