You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2013/07/02 08:51:19 UTC
[jira] [Commented] (HAMA-772) When selected
KeyValueTextInputFormat, workers get only one value for key
[ https://issues.apache.org/jira/browse/HAMA-772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697558#comment-13697558 ]
Edward J. Yoon commented on HAMA-772:
-------------------------------------
It would be nice if you included a unit test.
And, build fails as below:
{code}
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile (default-testCompile) on project hama-graph: Compilation failure
[ERROR] /home/edward/workspace/hama-trunk/graph/src/test/java/org/apache/hama/graph/example/PageRank.java:[91,16] error: PagerankSeqReader is not abstract and does not override abstract method newList() in RecordConverter
[ERROR] -> [Help 1]
[ERROR]
{code}
> When selected KeyValueTextInputFormat, workers get only one value for key
> -------------------------------------------------------------------------
>
> Key: HAMA-772
> URL: https://issues.apache.org/jira/browse/HAMA-772
> Project: Hama
> Issue Type: Bug
> Components: bsp core
> Affects Versions: 0.6.2
> Reporter: Ikhtiyor Ahmedov
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: HAMA-772.patch
>
> Original Estimate: 6h
> Remaining Estimate: 6h
>
> When KeyValueTextInputFormat selected as job input format, worker tasks are getting only one value for given key.
> Reason: In PartitioningRunner class for collecting data into memory used Map<Integer, Map<Writable, Writable>>, where Integer for worker id, Map is for key/values, if multiple values for same key, all values will be overwritten by the last value.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira