You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@tez.apache.org by Raajay <ra...@gmail.com> on 2015/09/10 03:41:52 UTC

How to use tez-site.xml

I have a custom java application that functions as a tez client. For
certain DAGs, I need specialized Processor classes, that I add as a jar
file to the HDFS and modify the "tez.lib.uris" field in my Configuration.


Is that sufficient ? Should the "tez.lib.uris" in the "tez-site.xml" in
worker nodes also be update to include the new "jar" dependencies ?

Thanks
Raajay

Re: How to use tez-site.xml

Posted by Raajay <ra...@gmail.com>.

Great. Thanks !

Raajay

On Wed, Sep 9, 2015 at 8:46 PM, Bikas Saha <bi...@hortonworks.com> wrote:

> For your own custom jars you should use “tez.aux.uris” instead of
> “tez.lib.uris”
>
>
>
> These configs only need to be present on the client node that is used to
> submit the DAG. tez-site.xml is not relevant on non-client nodes.
>
>
>
> Bikas
>
>
>
> *From:* Raajay [mailto:raajay.v@gmail.com]
> *Sent:* Wednesday, September 09, 2015 6:42 PM
> *To:* user@tez.apache.org
> *Subject:* How to use tez-site.xml
>
>
>
> I have a custom java application that functions as a tez client. For
> certain DAGs, I need specialized Processor classes, that I add as a jar
> file to the HDFS and modify the "tez.lib.uris" field in my Configuration.
>
> Is that sufficient ? Should the "tez.lib.uris" in the "tez-site.xml" in
> worker nodes also be update to include the new "jar" dependencies ?
>
> Thanks
>
> Raajay
>

RE: How to use tez-site.xml

Posted by Bikas Saha <bi...@hortonworks.com>.

For your own custom jars you should use “tez.aux.uris” instead of “tez.lib.uris”

These configs only need to be present on the client node that is used to submit the DAG. tez-site.xml is not relevant on non-client nodes.

Bikas

From: Raajay [mailto:raajay.v@gmail.com]
Sent: Wednesday, September 09, 2015 6:42 PM
To: user@tez.apache.org
Subject: How to use tez-site.xml

I have a custom java application that functions as a tez client. For certain DAGs, I need specialized Processor classes, that I add as a jar file to the HDFS and modify the "tez.lib.uris" field in my Configuration.

Is that sufficient ? Should the "tez.lib.uris" in the "tez-site.xml" in worker nodes also be update to include the new "jar" dependencies ?
Thanks
Raajay