You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/01/04 14:51:58 UTC
[jira] [Commented] (IGNITE-4516) Hadoop: add optional gzip
compression for shuffle output
[ https://issues.apache.org/jira/browse/IGNITE-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15798440#comment-15798440 ]
ASF GitHub Bot commented on IGNITE-4516:
----------------------------------------
GitHub user devozerov opened a pull request:
https://github.com/apache/ignite/pull/1399
IGNITE-4516
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gridgain/apache-ignite ignite-4516
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/ignite/pull/1399.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1399
----
commit 795a97584db46898b92c2a93b434ab9c48615563
Author: devozerov <vo...@gridgain.com>
Date: 2017-01-04T13:33:19Z
Added GZIP property.
commit 654e7e45ad962a440ca37b9dd5d8f72b0d7a3852
Author: devozerov <vo...@gridgain.com>
Date: 2017-01-04T13:51:17Z
Implemented write part.
commit 9cbd9abaf3e9d7d9f7df0a9751749d34eb16dbb7
Author: devozerov <vo...@gridgain.com>
Date: 2017-01-04T13:59:57Z
Implemented read part.
commit 35344e5ec0e882cc3bf2d06c5a3b4967323a8fa4
Author: devozerov <vo...@gridgain.com>
Date: 2017-01-04T14:30:53Z
Added TeraSort test.
----
> Hadoop: add optional gzip compression for shuffle output
> --------------------------------------------------------
>
> Key: IGNITE-4516
> URL: https://issues.apache.org/jira/browse/IGNITE-4516
> Project: Ignite
> Issue Type: Task
> Components: hadoop
> Reporter: Vladimir Ozerov
> Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> It was already implemented, but then reverted back due to performance drop. However, this feature might still be very useful because it decrease amount of heap memory required to store intermediate output for remote nodes.
> See commit 0062362.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)