[jira] [Created] (PIG-3751) Generating Splits in Tez should be configurable to AM or client

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

Rohini Palaniswamy created PIG-3751:
---------------------------------------

             Summary: Generating Splits in Tez should be configurable to AM or client
                 Key: PIG-3751
                 URL: https://issues.apache.org/jira/browse/PIG-3751
             Project: Pig
          Issue Type: Sub-task
    Affects Versions: tez-branch
            Reporter: Rohini Palaniswamy
            Assignee: Rohini Palaniswamy


1) TEZ-752 allows setting list of URIs to get delegation tokens. Set that to make Tez get delegation tokens and calculate input splits on AM
2) Try using Tez Grouping of input splits instead of pig.maxCombinedSplitSize grouping.

Generating splits in AM is supposed to give performance boost. For those case where InputFormat or OutputFormat get delegation tokens and it is not possible to do that, then have a option to generate input splits on client. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)