[jira] [Updated] (TEZ-1300) Change default tez classpath to not include hadoop jars from the cluster

["Siddharth Seth (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Seth updated TEZ-1300:
--------------------------------

    Attachment: TEZ-1300.1.txt

First version of the patch.

Makes the following changes.
--- tez.lib.uris semantics changed
--Specifying a single .tar.gz or .tgz assumes that a compressed version of the tez libs is being used. This is uncompressed into a tezlibs directory when running containers, and tezlibs/*;tezlibs/lib/* are added to the classpath (after . and .*)
--If multiple files are specified - files are localized as regular files, contents of directories are localized as regular files (non-recursive).

--- When building tez
-- There's one less directory in the dist builds. e.g. tez-dist-0.5.0-incubating/tez-dist-0.5.0-SNAPSHOT/* is now tez-dist-0.5.0-SNAPSHOT/*
-- One additional target - tez-archive-0.5.0-SNAPSHOT.tar.gz is always built, which is a full build of tez - including hadoop libs
-- tez-dist-full removed.
-- tez-dist is now a full set of jars including hadoop
-- tez-dist-partial is a new taget build which does not include hadoop libs

-- Some minor fixes in prewarm environment setup
-- Changes the FileSystem API used to get file info to not pull block locations.
-- INSTALL notes updated. I'm guessing I need to change this elsewhere as well. Will find other references and update in another revision of the patch.

[~hitesh] - review please

One more change which I'm likely to make in an updated patch - rename tez-dist to tez-dist-withHadoopLibs, and tez-dist-partial to tez-dist-withoutHadoopLibs
Rename to "withHadoopLibs" / "withoutHadoopLibs".

> Change default tez classpath to not include hadoop jars from the cluster
> ------------------------------------------------------------------------
>
>                 Key: TEZ-1300
>                 URL: https://issues.apache.org/jira/browse/TEZ-1300
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: TEZ-1300.1.txt
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)