You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Mohammad Kamrul Islam (JIRA)" <ji...@apache.org> on 2014/03/01 03:03:21 UTC

[jira] [Updated] (TEZ-873) Allow MRInputLegacy to expose the individual input split

     [ https://issues.apache.org/jira/browse/TEZ-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mohammad Kamrul Islam updated TEZ-873:
--------------------------------------

    Attachment: TEZ-873.2.patch

Addressed the review comments.

> Allow MRInputLegacy to expose the individual input split
> --------------------------------------------------------
>
>                 Key: TEZ-873
>                 URL: https://issues.apache.org/jira/browse/TEZ-873
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Mohammad Kamrul Islam
>            Assignee: Mohammad Kamrul Islam
>         Attachments: TEZ-873.1.patch, TEZ-873.2.patch
>
>
> Currently there is no way of getting InputSplit from TezProcessor. In current MR framework, there is  a way to find out the filename through FileSplit.  For example, one common uses is to get the filename in map
> String fileName = ((FileSplit) context.getInputSplit()).getPath().getName();
> There are other meta-data in Inputsplit that could be used by existing MR user.
> This JIRA is to add APIs to expose the InputSplit by adding these   TezGroupedSplit.getWrapperSplit() and MRInput.getInputSplit().
> Although MRInputLegacy provide an API to get the InputSplit, it has few issues:
>  * Without TezGroupedSplit.getWrapperSplit() it is unusable.
>  * Since it is used in various use cases, I propose to move it from MRInputLegacy to MRInput.
> * Currently the APIs are named as getNewInputSplit() and getOldInputSplit().  These should be merged into one : getInputSplit(). The new/old API should be handled internally.
> Please give your feedback.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)