You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/10/06 00:40:27 UTC

[jira] [Created] (PIG-4691) [Pig on Tez] Support for whitelisting storefuncs for union optimization

Rohini Palaniswamy created PIG-4691:
---------------------------------------

             Summary: [Pig on Tez] Support for whitelisting storefuncs for union optimization
                 Key: PIG-4691
                 URL: https://issues.apache.org/jira/browse/PIG-4691
             Project: Pig
          Issue Type: Bug
            Reporter: Rohini Palaniswamy
            Assignee: Rohini Palaniswamy
             Fix For: 0.16.0


PIG-4649 added support for blacklisting some storefuncs when applying union+store vertex group optimization as HCatStorer was not honoring mapreduce.output.basename and hardcoding part file names. Found that some of our user StoreFuncs also do that and ended up with partial results. So would be good to have a whitelist option as well where you can put StoreFuncs that do not mess with mapreduce.output.basename.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)