You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2014/01/08 05:32:50 UTC

[jira] [Commented] (HAMA-837) Add sort behaviour to runtime partitioner

    [ https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865054#comment-13865054 ] 

Edward J. Yoon commented on HAMA-837:
-------------------------------------

Found a bug in SemiClustering. In below case, deepcopy should be used.

{code}
- Vertex<Text, DoubleWritable, SemiClusterMessage> v = this;
+ Vertex<Text, DoubleWritable, SemiClusterMessage> v = this.deepCopy();
{code}

> Add sort behaviour to runtime partitioner
> -----------------------------------------
>
>                 Key: HAMA-837
>                 URL: https://issues.apache.org/jira/browse/HAMA-837
>             Project: Hama
>          Issue Type: Bug
>          Components: bsp core
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.7.0
>
>         Attachments: HAMA-837_v01.patch, HAMA-837_v02.patch
>
>
> If key is comparable and it need to be sorted by key of record, 
> {code}
>       if (outputPair.getKey() instanceof WritableComparable
>           && conf.getBoolean(Constants.PARTITION_SORT_BY_KEY, false)) {
> {code}
> each patitions should be sorted by key. In here, we can use external merge sort.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)