[jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance

["Ashish Agarwal (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014941#comment-13014941 ] 

Ashish Agarwal commented on HAMA-367:
-------------------------------------

Hi,

I did some research 
- looked at the paper above 
- read chapter 1 of the book Parallel Scientific Computing - A structured approach ... by R.H.Bisseling
- looked at the paper "Adaptive-Compi: Enhancing Mpi-Based Applications’ Performance and Scalability by using Adaptive Compression"

and some online tutorials about MPI.

In the project, we would be looking at two areas -

1. Study different compression algorithms and implement the ones that are able to exploit the unique characteristics of MPI messages.

2. Develop an adaptive compression algorithm - where we could first identify the datatype of the file that is to be compressed and then use the appropriate compression. 


Thanks
Ashish




> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
>                 Key: HAMA-367
>                 URL: https://issues.apache.org/jira/browse/HAMA-367
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.3.0
>            Reporter: Edward J. Yoon
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.3.0
>
>   Original Estimate: 2016h
>  Remaining Estimate: 2016h
>
> As you know, the exchanging data between processes, is a core part of whole performance in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale distributed message-passing systems to reduce the communication time of individual messages and to improve the bandwidth of the overall system. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira