You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by Jahan <ja...@gmail.com> on 2017/12/14 17:53:36 UTC

Tez custom counters

Hi

Is it possible to implement a custom counters when running jobs via hive.?
My use case when i run the ETL would like collect the statistics of certain
columns.

I am looking for something similar like https://www.linkedin.com/
pulse/custom-counters-hadoop-gaurav-singh

Any examples/link to examples would be helpful.

Of course I can accomplish this via running sql after the table load, but
would like to get them in counter so that i can pick them up from timeline
server or hs2 logs

Regards Jahan

Re: Tez custom counters

Posted by Siddharth Seth <ss...@apache.org>.
This question would be best answered by the Hive user list (CCd).

On Thu, Dec 14, 2017 at 9:53 AM, Jahan <ja...@gmail.com> wrote:

> Hi
>
> Is it possible to implement a custom counters when running jobs via hive.?
> My use case when i run the ETL would like collect the statistics of certain
> columns.
>
> I am looking for something similar like https://www.linkedin.com/
> pulse/custom-counters-hadoop-gaurav-singh
>
> Any examples/link to examples would be helpful.
>
> Of course I can accomplish this via running sql after the table load, but
> would like to get them in counter so that i can pick them up from timeline
> server or hs2 logs
>
> Regards Jahan
>

Re: Tez custom counters

Posted by Siddharth Seth <ss...@apache.org>.
This question would be best answered by the Hive user list (CCd).

On Thu, Dec 14, 2017 at 9:53 AM, Jahan <ja...@gmail.com> wrote:

> Hi
>
> Is it possible to implement a custom counters when running jobs via hive.?
> My use case when i run the ETL would like collect the statistics of certain
> columns.
>
> I am looking for something similar like https://www.linkedin.com/
> pulse/custom-counters-hadoop-gaurav-singh
>
> Any examples/link to examples would be helpful.
>
> Of course I can accomplish this via running sql after the table load, but
> would like to get them in counter so that i can pick them up from timeline
> server or hs2 logs
>
> Regards Jahan
>