You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2015/01/16 14:12:34 UTC

[jira] [Updated] (TEZ-1855) Avoid scanning for previously written files within Inputs / Outputs

     [ https://issues.apache.org/jira/browse/TEZ-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Balamohan updated TEZ-1855:
----------------------------------
    Attachment: TEZ-1855.1.patch

[~sseth], [~gopalv] - Please review.

> Avoid scanning for previously written files within Inputs / Outputs
> -------------------------------------------------------------------
>
>                 Key: TEZ-1855
>                 URL: https://issues.apache.org/jira/browse/TEZ-1855
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>         Attachments: TEZ-1855.1.patch
>
>
> TezTaskOutput has a bunch of methods - getOutputFile, getOutputIndexFile, getSpillIndexFile - which are used within an  Output to scan for files written earlier by the same Output. This should be avoided in favour of keeping track of previously written files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)