You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by lulynn_2008 <lu...@163.com> on 2012/05/21 05:03:09 UTC
[pig-0.10.0]: what jar are included in pig-0.10.0.jar and
pig-0.10.0-withouthadoop.jar?
Hi,
I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar.
I have questions about them:
1. Seems the differences between these two jars are: pig-0.10.0.jar includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar just includes the dependencies besides hadoop and hadoop dependencies. Am I right?
2. How to get the jar files list in the two jar files? I mean how can I know what dependencies are included in the two jar files?
3. If I want to use hadoop jar files from a external hadoop package, should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop dependencies in pig classpath?
Thanks.
Re:Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and
pig-0.10.0-withouthadoop.jar?
Posted by lulynn_2008 <lu...@163.com>.
Thanks. Totally agree with you.
At 2012-05-22 18:25:13,"praveenesh kumar" <pr...@gmail.com> wrote:
>As far as I know pig-0.10.0-withouthadoop.jar is generally used when you
>want to use your own distribution of hadoop to use with PIG. Having said
>that, yes it won't include any hadoop dependencies. If you want to use
>hadoop jar files from a external hadoop package, just use
>pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop
>dependencies in pig classpath, this is how I am doing it.
>Also put pig-0.10.0-wihouthadoop.jar in HADOOP_CLASSPATH also, just to be
>in safe side (although its not required).
>
>Regards,
>Praveenesh
>
>On Tue, May 22, 2012 at 1:58 PM, IGZ Nick <ig...@gmail.com> wrote:
>
>> 1. I guess so, not sure though.. I haven't checked.
>> 2. You can do a jar -tvf <jar file> to find out which classes are present
>> in a particular jar. You can do a jar -xvf <jar file> to extract the jar
>> file ot the current dir.
>> 3. If point no. 1 is true, this should surely work!
>>
>> On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <lu...@163.com> wrote:
>>
>> > Hi,
>> >
>> > I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and
>> > pig-0.10.0-withouthadoop.jar.
>> > I have questions about them:
>> > 1. Seems the differences between these two jars are: pig-0.10.0.jar
>> > includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar
>> just
>> > includes the dependencies besides hadoop and hadoop dependencies. Am I
>> > right?
>> > 2. How to get the jar files list in the two jar files? I mean how can I
>> > know what dependencies are included in the two jar files?
>> > 3. If I want to use hadoop jar files from a external hadoop package,
>> > should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files
>> > and hadoop dependencies in pig classpath?
>> >
>> > Thanks.
>> >
>>
Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
Posted by praveenesh kumar <pr...@gmail.com>.
As far as I know pig-0.10.0-withouthadoop.jar is generally used when you
want to use your own distribution of hadoop to use with PIG. Having said
that, yes it won't include any hadoop dependencies. If you want to use
hadoop jar files from a external hadoop package, just use
pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop
dependencies in pig classpath, this is how I am doing it.
Also put pig-0.10.0-wihouthadoop.jar in HADOOP_CLASSPATH also, just to be
in safe side (although its not required).
Regards,
Praveenesh
On Tue, May 22, 2012 at 1:58 PM, IGZ Nick <ig...@gmail.com> wrote:
> 1. I guess so, not sure though.. I haven't checked.
> 2. You can do a jar -tvf <jar file> to find out which classes are present
> in a particular jar. You can do a jar -xvf <jar file> to extract the jar
> file ot the current dir.
> 3. If point no. 1 is true, this should surely work!
>
> On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <lu...@163.com> wrote:
>
> > Hi,
> >
> > I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and
> > pig-0.10.0-withouthadoop.jar.
> > I have questions about them:
> > 1. Seems the differences between these two jars are: pig-0.10.0.jar
> > includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar
> just
> > includes the dependencies besides hadoop and hadoop dependencies. Am I
> > right?
> > 2. How to get the jar files list in the two jar files? I mean how can I
> > know what dependencies are included in the two jar files?
> > 3. If I want to use hadoop jar files from a external hadoop package,
> > should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files
> > and hadoop dependencies in pig classpath?
> >
> > Thanks.
> >
>
Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
Posted by IGZ Nick <ig...@gmail.com>.
1. I guess so, not sure though.. I haven't checked.
2. You can do a jar -tvf <jar file> to find out which classes are present
in a particular jar. You can do a jar -xvf <jar file> to extract the jar
file ot the current dir.
3. If point no. 1 is true, this should surely work!
On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <lu...@163.com> wrote:
> Hi,
>
> I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and
> pig-0.10.0-withouthadoop.jar.
> I have questions about them:
> 1. Seems the differences between these two jars are: pig-0.10.0.jar
> includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar just
> includes the dependencies besides hadoop and hadoop dependencies. Am I
> right?
> 2. How to get the jar files list in the two jar files? I mean how can I
> know what dependencies are included in the two jar files?
> 3. If I want to use hadoop jar files from a external hadoop package,
> should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files
> and hadoop dependencies in pig classpath?
>
> Thanks.
>