You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org> on 2012/01/28 12:17:10 UTC
[jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages
to Improve the Performance
[ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195488#comment-13195488 ]
Thomas Jungblut commented on HAMA-367:
--------------------------------------
Looks good to me, was it that easy? However it seems that you haven't included the "BSPCompressedBundle".
You can make "svn stat" on the project root and see what you haven't included yet, it has a question mark on the left.
Then you can call "svn add <the file or dir>" and diff the patch again.
It would be nice if you can include this before I start to test this.
How expensive is "BSPMessageCompressor.getCompressionRatio()"?
Does it just compare the byte[] length?
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
> Key: HAMA-367
> URL: https://issues.apache.org/jira/browse/HAMA-367
> Project: Hama
> Issue Type: New Feature
> Components: bsp, documentation
> Affects Versions: 0.4.0
> Reporter: Edward J. Yoon
> Labels: gsoc, gsoc2011, mentor
> Attachments: HAMA-367.patch, test_files.tar.gz
>
> Original Estimate: 2,016h
> Remaining Estimate: 2,016h
>
> As you know, the exchanging data between processes, is a core part of whole performance in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale distributed message-passing systems to reduce the communication time of individual messages and to improve the bandwidth of the overall system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages
to Improve the Performance
Posted by Apurv Verma <da...@gmail.com>.
I am sorry, I am doing the add now and submitting the new patch.
Yes, getCompressionRatio() just compares the byte length.
I observed that for small message bundles the compressed length may be
greater than the original uncompressed length therefore I added this case.
--
thanks and regards,
Apurv Verma
B. Tech.(CSE)
IIT- Ropar
On Sat, Jan 28, 2012 at 4:47 PM, Thomas Jungblut (Commented) (JIRA) <
jira@apache.org> wrote:
>
> [
> https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195488#comment-13195488]
>
> Thomas Jungblut commented on HAMA-367:
> --------------------------------------
>
> Looks good to me, was it that easy? However it seems that you haven't
> included the "BSPCompressedBundle".
>
> You can make "svn stat" on the project root and see what you haven't
> included yet, it has a question mark on the left.
> Then you can call "svn add <the file or dir>" and diff the patch again.
>
> It would be nice if you can include this before I start to test this.
>
> How expensive is "BSPMessageCompressor.getCompressionRatio()"?
> Does it just compare the byte[] length?
>
> > Runtime Compression of BSP Messages to Improve the Performance
> > --------------------------------------------------------------
> >
> > Key: HAMA-367
> > URL: https://issues.apache.org/jira/browse/HAMA-367
> > Project: Hama
> > Issue Type: New Feature
> > Components: bsp, documentation
> > Affects Versions: 0.4.0
> > Reporter: Edward J. Yoon
> > Labels: gsoc, gsoc2011, mentor
> > Attachments: HAMA-367.patch, test_files.tar.gz
> >
> > Original Estimate: 2,016h
> > Remaining Estimate: 2,016h
> >
> > As you know, the exchanging data between processes, is a core part of
> whole performance in Bulk Synchronous Parallel.
> > In this research, we investigate BSP message data compression in the
> context of large-scale distributed message-passing systems to reduce the
> communication time of individual messages and to improve the bandwidth of
> the overall system.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators:
> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>