operators in a Tez vertex

[Grandl Robert <rg...@yahoo.com>]

Hi guys,
Given a Hive query, I want to map the operators which runs in every Tez vertex. Is there any easy way I can do that ? 

Thanks,Robert

Re: operators in a Tez vertex

[Hitesh Shah <hi...@apache.org>]

Hello Robert, 

I believe currently the only way to do is this from the hive explain plan as most of this information is inaccessible to Tez ( it is passed in via the user payloads and only parsed by the Hive Processor ). I believe if you enable the ATSHooks in Hive, it publishes such information to the YARN timeline server for each submitted query. Tez has added some hooks for applications to inject some additional data into the Tez DAG plan which can then be leveraged in the Tez UI but I don’t believe folks in Hive have started looking at integrating into this layer yet. 

thanks
— Hitesh


On Feb 5, 2015, at 2:26 PM, Grandl Robert <rg...@yahoo.com> wrote:

> Hi guys,
> 
> Given a Hive query, I want to map the operators which runs in every Tez vertex. Is there any easy way I can do that ? 
> 
> Thanks,
> Robert
> 
>