You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2013/07/02 08:51:19 UTC

[jira] [Commented] (HAMA-772) When selected KeyValueTextInputFormat, workers get only one value for key

    [ https://issues.apache.org/jira/browse/HAMA-772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697558#comment-13697558 ] 

Edward J. Yoon commented on HAMA-772:
-------------------------------------

It would be nice if you included a unit test. 

And, build fails as below:

{code}
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile (default-testCompile) on project hama-graph: Compilation failure
[ERROR] /home/edward/workspace/hama-trunk/graph/src/test/java/org/apache/hama/graph/example/PageRank.java:[91,16] error: PagerankSeqReader is not abstract and does not override abstract method newList() in RecordConverter
[ERROR] -> [Help 1]
[ERROR] 
{code}
                
> When selected KeyValueTextInputFormat, workers get only one value for key
> -------------------------------------------------------------------------
>
>                 Key: HAMA-772
>                 URL: https://issues.apache.org/jira/browse/HAMA-772
>             Project: Hama
>          Issue Type: Bug
>          Components: bsp core
>    Affects Versions: 0.6.2
>            Reporter: Ikhtiyor Ahmedov
>            Priority: Minor
>             Fix For: 0.7.0
>
>         Attachments: HAMA-772.patch
>
>   Original Estimate: 6h
>  Remaining Estimate: 6h
>
> When KeyValueTextInputFormat selected as job input format, worker tasks are getting only one value for given key.
> Reason: In PartitioningRunner class for collecting data into memory used Map<Integer, Map<Writable, Writable>>, where Integer for worker id, Map is for key/values, if multiple values for same key, all values will be overwritten by the last value.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira