[jira] [Commented] (PIG-3767) Work with TEZ-668 which allows starting and closing of inputs and outputs

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903873#comment-13903873 ] 

Rohini Palaniswamy commented on PIG-3767:
-----------------------------------------

 TEZ-688 is committed to tez trunk. Attached patch tested with that. https://reviews.apache.org/r/18203/

> Work with TEZ-668 which allows starting and closing of inputs and outputs
> -------------------------------------------------------------------------
>
>                 Key: PIG-3767
>                 URL: https://issues.apache.org/jira/browse/PIG-3767
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: tez-branch
>
>         Attachments: PIG-3767-1.patch, PIG-3767-2.patch
>
>
> From [~bikassaha]:
> https://issues.apache.org/jira/browse/TEZ-668 is a breaking change in TEZ trunk
>  
> This adds a start method to the Input/Output and the processor is expected to call input.start()/output.start() for the input/output to actually start fetching/writing data. After this get committed, Hive and Pig Processors need to call start() on the input/output that they want to start. The processors may decide to not call start for an input they do not want to read (e.g. data already in ObjectRegistry) or they may choose to stagger the inputs in a certain order based on memory or processing requirements.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)