You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Andrew Oliver <ac...@gmail.com> on 2014/09/08 19:58:49 UTC
add flag to force jars local
I realize that my earlier mail was to users@ which was probably not
appropriate for this part:
When you do something like this:
pig -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig
Pig tries to load all jars (including those in PIG_CLASSPATH) from HDFS.
That isn't necessarily desirable when you want to centralize your scripts
to avoid a single point of failure but avoid some kind of multi-person jar
hell or some kind of deployment fun for platform upgrades.
Would anyone object if I add something like this?:
pig -Dforcelocaljars=true -useHCatalog
hdfs://myserver:8020/load/scripts/mydir/myscript.pig
or should it be more like this
pig -forceLocalJars -useHCatalog
hdfs://myserver:8020/load/scripts/mydir/myscript.pig
With your guidance I'll provide a patch.
Thanks,
Andy