You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2015/02/12 05:18:11 UTC

[jira] [Commented] (HAMA-903) Refactor Queue interface and implementations

    [ https://issues.apache.org/jira/browse/HAMA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317566#comment-14317566 ] 

Hudson commented on HAMA-903:
-----------------------------

SUCCESS: Integrated in Hama-trunk #344 (See [https://builds.apache.org/job/Hama-trunk/344/])
HAMA-903: Refactor Queue interface and implementations (edwardyoon: rev 1659134)
* /hama/trunk/core/src/main/java/org/apache/hama/Constants.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPMessageBundle.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/LocalBSPRunner.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AbstractMessageManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AbstractOutgoingMessageManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/BSPMessageInterface.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/ByteArrayMessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/DefaultMessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/DiskQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MemoryQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SingleLockQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SortedMemoryQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SpillingQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SynchronizedQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPMasterGroomServer.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestPartitioning.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestPersistQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestDiskQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestHamaAsyncMessageManager.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestHamaMessageManager.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestSpillingQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/pipes/TestPipes.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/IncomingVertexMessageManager.java


> Refactor Queue interface and implementations
> --------------------------------------------
>
>                 Key: HAMA-903
>                 URL: https://issues.apache.org/jira/browse/HAMA-903
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>    Affects Versions: 0.6.4
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.7.0
>
>         Attachments: HAMA-903_v01.patch, HAMA-903_v02.patch
>
>
> Instead of unbundling (and deserializing, decompressing) bundles into memory, disk, or spilling queue, we should use bundles in efficient and asynchronous way. My idea is using of bundle's iterator directly. 
> This will reduce the memory space and improve the performance.
> P.S., For the sorted queue, I'll create sub-ticket.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)