You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2015/07/30 07:30:04 UTC

[jira] [Commented] (TEZ-2659) Enhance ATSImportTool to download additional data related to the job

    [ https://issues.apache.org/jira/browse/TEZ-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647210#comment-14647210 ] 

Hitesh Shah commented on TEZ-2659:
----------------------------------

Why not apply a different approach i.e. make Hive or any other layer pass their ATS entity id+type information which Tez can store along with the DAG?

What will ATSImportTool do with these 3rd party data given that it cannot do anything with it with app-specific parsers/logic?  

> Enhance ATSImportTool to download additional data related to the job
> --------------------------------------------------------------------
>
>                 Key: TEZ-2659
>                 URL: https://issues.apache.org/jira/browse/TEZ-2659
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>
> For example, hive might add its data via ATSHook.  ATSImportTool should be able to download such data provided via additional URLs and populate in "additionalInfo" tag. It would be upto to the higher level apps to parse the data.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)