[jira] [Created] (TEZ-1593) PipelinedSorter::compare() makes a key-copy to satisfy RawComparator interface

["Gopal V (JIRA)" <ji...@apache.org>]

Gopal V created TEZ-1593:
----------------------------

             Summary: PipelinedSorter::compare() makes a key-copy to satisfy RawComparator interface
                 Key: TEZ-1593
                 URL: https://issues.apache.org/jira/browse/TEZ-1593
             Project: Apache Tez
          Issue Type: Bug
    Affects Versions: 0.6.0
            Reporter: Gopal V
            Assignee: Gopal V


The current implementation of PipelinedSorter has a slow section which revolves around key comparisons.

{code}
      kvbuffer.position(istart);
      kvbuffer.get(ki, 0, ilen);
      kvbuffer.position(jstart);
      kvbuffer.get(kj, 0, jlen);
      // sort by key
      final int cmp = comparator.compare(ki, 0, ilen, kj, 0, jlen);
{code}

The kvbuffer.get into the arrays ki and kj are the slowest part of the comparator operation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)