You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Andrew Oliver <ac...@gmail.com> on 2014/09/08 19:58:49 UTC

add flag to force jars local

I realize that my earlier mail was to users@ which was probably not
appropriate for this part:

When you do something like this:

pig -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig

Pig tries to load all jars (including those in PIG_CLASSPATH) from HDFS.
That isn't necessarily desirable when you want to centralize your scripts
to avoid a single point of failure but avoid some kind of multi-person jar
hell or some kind of deployment fun for platform upgrades.

Would anyone object if I add something like this?:

pig -Dforcelocaljars=true -useHCatalog
hdfs://myserver:8020/load/scripts/mydir/myscript.pig

or should it be more like this

pig -forceLocalJars -useHCatalog
hdfs://myserver:8020/load/scripts/mydir/myscript.pig

With your guidance I'll provide a patch.

Thanks,

Andy