You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2014/11/20 12:46:33 UTC
[jira] [Comment Edited] (TEZ-1767) Enable RLE in reducer side merge
codepath
[ https://issues.apache.org/jira/browse/TEZ-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219298#comment-14219298 ]
Rajesh Balamohan edited comment on TEZ-1767 at 11/20/14 11:45 AM:
------------------------------------------------------------------
Evaluated the perf with a synthetic job (m1, m2 sending data to "joiner") in test cluster. Job didn't have much filters.
Counters in joiner vertex:
|| ||JobRuntime (sec)||BYTES_READ||BYTES_WRITTEN||ADDITIONAL_SPILLS_BYTES_READ||ADDITIONAL_SPILLS_BYTES_WRITTEN||
|Without patch|115|6209631329|5804631041|3047530212|2871600044|
|With patch|93|5206613978|4830943467|2555377057|2426325211|
[~gopalv], [~sseth] - Can you please review?
was (Author: rajesh.balamohan):
Evaluated the perf with a synthetic job (m1, m2 sending data to "joiner") in test cluster. Job didn't have much filters.
Counters in joiner vertex:
|| ||JobRuntime (sec)||BYTES_READ||BYTES_WRITTEN||ADDITIONAL_SPILLS_BYTES_READ||ADDITIONAL_SPILLS_BYTES_WRITTEN||
|Without patch|115|6209631329|5804631041|3047530212|2871600044|
|With patch|93|5206613978|4830943467|2555377057|2426325211|
> Enable RLE in reducer side merge codepath
> -----------------------------------------
>
> Key: TEZ-1767
> URL: https://issues.apache.org/jira/browse/TEZ-1767
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-1767.1.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)