Specifying multiple jars for giraph job

[Kyle Orlando <ky...@gmail.com>]

Hi,

If you have code that you'd like to use that's in a separate jar file,
what's the best way to include it when running a giraph job? I've
never been able to get the -libjars command to work properly for
hadoop, nor do I really know what it's exact purpose is, but thus far
I've just been combining all of the giraph jars + my jars into one
mega jar file, so my command looks like "hadoop jar combined.jar
org.apache.giraph.GiraphRunner ..."   It's been working fine, but
there has to be a better way to do this!

Thanks,
-- 
Kyle Orlando
Computer Engineering Major
University of Maryland

Re: Specifying multiple jars for giraph job

[Claudio Martella <cl...@gmail.com>]

-libjars is exactly what you need.

make sure you set HADOOP_CLASSPATH accordingly too.

e.g.

export HADOOP_CLASSPATH="giraph.jar:your.jar"
hadoop jar giraph.jar org.apache.giraph.GiraphRunner [ -D option ]*
-libjars your.jar your.package.ComputationClass [ GiraphRunner option e.g.
-vip -vif etc. ]*


On Tue, Aug 13, 2013 at 8:47 PM, Kyle Orlando <ky...@gmail.com>wrote:

> Hi,
>
> If you have code that you'd like to use that's in a separate jar file,
> what's the best way to include it when running a giraph job? I've
> never been able to get the -libjars command to work properly for
> hadoop, nor do I really know what it's exact purpose is, but thus far
> I've just been combining all of the giraph jars + my jars into one
> mega jar file, so my command looks like "hadoop jar combined.jar
> org.apache.giraph.GiraphRunner ..."   It's been working fine, but
> there has to be a better way to do this!
>
> Thanks,
> --
> Kyle Orlando
> Computer Engineering Major
> University of Maryland
>



-- 
   Claudio Martella
   claudio.martella@gmail.com