You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Mohammad Kamrul Islam (JIRA)" <ji...@apache.org> on 2014/02/21 20:41:20 UTC
[jira] [Created] (TEZ-873) Allow Tez processor access to meta-data
through input split
Mohammad Kamrul Islam created TEZ-873:
-----------------------------------------
Summary: Allow Tez processor access to meta-data through input split
Key: TEZ-873
URL: https://issues.apache.org/jira/browse/TEZ-873
Project: Apache Tez
Issue Type: Bug
Reporter: Mohammad Kamrul Islam
Assignee: Mohammad Kamrul Islam
Currently there is no way of getting InputSplit from TezProcessor. In current MR framework, there is a way to find out the filename through FileSplit. For example, one common uses is to get the filename in map
String fileName = ((FileSplit) context.getInputSplit()).getPath().getName();
There are other meta-data in Inputsplit that could be used by existing MR user.
This JIRA is to add APIs to expose the InputSplit by adding these TezGroupedSplit.getWrapperSplit() and MRInput.getInputSplit().
Although MRInputLegacy provide an API to get the InputSplit, it has few issues:
* Without TezGroupedSplit.getWrapperSplit() it is unusable.
* Since it is used in various use cases, I propose to move it from MRInputLegacy to MRInput.
* Currently the APIs are named as getNewInputSplit() and getOldInputSplit(). These should be merged into one : getInputSplit(). The new/old API should be handled internally.
Please give your feedback.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)