You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2012/12/17 12:26:12 UTC
[jira] [Commented] (HAMA-700) BSPPartitioner should be configurable
to be optional and allow input format conversion
[ https://issues.apache.org/jira/browse/HAMA-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533857#comment-13533857 ]
Edward J. Yoon commented on HAMA-700:
-------------------------------------
Your approach is that, 1) writes converted record to a split, 2) and then each GraphJobRunner task just reads vertices from assigned split. So, there's no way to avoid writing every records to a files when the input is a table of NoSQL. Right? If so, this issue should be closed as a "won't fix".
> BSPPartitioner should be configurable to be optional and allow input format conversion
> --------------------------------------------------------------------------------------
>
> Key: HAMA-700
> URL: https://issues.apache.org/jira/browse/HAMA-700
> Project: Hama
> Issue Type: Improvement
> Components: bsp core
> Reporter: Suraj Menon
> Assignee: Suraj Menon
> Fix For: 0.6.1
>
> Attachments: HAMA-700-v1.patch
>
>
> There should be a provisioning for skipping the PartitionRunner if needed. Also we can have a RecordConverter interface so that the PartitionRunner can read the input in any format and create new splits.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira