You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2013/06/07 20:20:20 UTC

[jira] [Commented] (TEZ-189) Add helper apis to generate splits for applications moving away from MR to Tez

    [ https://issues.apache.org/jira/browse/TEZ-189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678252#comment-13678252 ] 

Siddharth Seth commented on TEZ-189:
------------------------------------

Looks good to me. The consumer of the API (Hive in this case) will need to process SplitMetaInfo and add the files to the LocalResources on the DAG.

In a follow up jira, we could probably generate the splits - and let the users write them out to files or into the configuration fields for the vertices / inputs. This would require a runtime change as well.
                
> Add helper apis to generate splits for applications moving away from MR to Tez
> ------------------------------------------------------------------------------
>
>                 Key: TEZ-189
>                 URL: https://issues.apache.org/jira/browse/TEZ-189
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Hitesh Shah
>              Labels: TEZ-0.2.0
>         Attachments: TEZ-189.1.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira