[jira] [Created] (PIG-4685) SecondaryKeyOptimizerTez does not optimize cogroup

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

Rohini Palaniswamy created PIG-4685:
---------------------------------------

             Summary: SecondaryKeyOptimizerTez does not optimize cogroup
                 Key: PIG-4685
                 URL: https://issues.apache.org/jira/browse/PIG-4685
             Project: Pig
          Issue Type: Improvement
            Reporter: Rohini Palaniswamy


  In PIG-4683, [~daijy] pointed out that SecondaryKeyOptimizerTez does not optimize cogroup.

{code}
// Current code does not handle more than one predecessors
        // even though it is possible. The problem is when we
        // process the first predecessor, we remove the foreach inner
        // operators from the reduce side, and the second predecessor
        // cannot see them
        if (predecessors.size()>1) {
            return;
        }
{code}

It is a tricky case and we need to see how to fix it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)