You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by vasanth kumar <rj...@gmail.com> on 2013/02/15 14:53:40 UTC

Adding jar to war

Hi,

I was trying sqoop2 install with Hadoop 2.0 "hadoop-2.0.2-alpha-src.tar.gz"
binary-source package.
After sqoop2 build, executed addtowar.sh command. Script added *
hadoop-common-2.0.2-alpha-sources.jar* instead of *
hadoop-common-2.0.2-alpha.jar*, both jars are in same folder. Then got few
exception while adding starting jars. Later I added binary jar manually and
working fine.

Command execution
---------------------------------------------------------------------------------------------------
hadoop-path /usr/lib/hadoop2/
Hadoop version: 2.0
Hadoop path: /usr/lib/hadoop2/
Extra jars:

Injecting following Hadoop JARs

/usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/yarn/hadoop-yarn-common-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/yarn/hadoop-yarn-api-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/httpfs/tomcat/webapps/webhdfs/WEB-INF/lib/hadoop-hdfs-2.0.2-alpha.jar
*/usr/lib/hadoop2/share/hadoop/common/hadoop-common-2.0.2-alpha-sources.jar*
/usr/lib/hadoop2/share/hadoop/common/lib/hadoop-auth-2.0.2-alpha.jar
/usr/lib/hadoop2/share/hadoop/common/lib/guava-11.0.2.jar
/usr/lib/hadoop2/share/hadoop/common/lib/protobuf-java-2.4.0a.jar
/usr/lib/hadoop2/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar
/usr/lib/hadoop2/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar
/usr/lib/hadoop2/share/hadoop/common/lib/commons-configuration-1.6.jar
/usr/lib/hadoop2/share/hadoop/common/lib/commons-cli-1.2.jar
/usr/lib/hadoop2/share/hadoop/common/lib/commons-logging-1.1.1.jar
/usr/lib/hadoop2/share/hadoop/common/lib/slf4j-api-1.6.1.jar
/usr/lib/hadoop2/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar
/usr/lib/hadoop2/share/hadoop/common/lib/avro-1.5.3.jar

Backing up original WAR file to
./../server/webapps/sqoop.war_2013-02-15_19:20:06.784011030

New Sqoop WAR file with added 'Hadoop JARs' at ./../server/webapps/sqoop.war

---------------------------------------------------------------------------------------------------


Is it defect or I should use only hadoop 2.0 binary version only?

-- 
Regards
Vasanth kumar RJ

Re: Adding jar to war

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Yeah injecting the hadoop-common-2.0.2-alpha-sources.jar indeed doesn't make sense. Script addtowar.sh is kind of hard to keep in synch with all possibilities, so it might be better to remove it entirely. I've filled SQOOP-897 to keep track of that.

Jarcec

On Fri, Feb 15, 2013 at 07:23:40PM +0530, vasanth kumar wrote:
> Hi,
> 
> I was trying sqoop2 install with Hadoop 2.0 "hadoop-2.0.2-alpha-src.tar.gz"
> binary-source package.
> After sqoop2 build, executed addtowar.sh command. Script added *
> hadoop-common-2.0.2-alpha-sources.jar* instead of *
> hadoop-common-2.0.2-alpha.jar*, both jars are in same folder. Then got few
> exception while adding starting jars. Later I added binary jar manually and
> working fine.
> 
> Command execution
> ---------------------------------------------------------------------------------------------------
> hadoop-path /usr/lib/hadoop2/
> Hadoop version: 2.0
> Hadoop path: /usr/lib/hadoop2/
> Extra jars:
> 
> Injecting following Hadoop JARs
> 
> /usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/yarn/hadoop-yarn-common-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/yarn/hadoop-yarn-api-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/httpfs/tomcat/webapps/webhdfs/WEB-INF/lib/hadoop-hdfs-2.0.2-alpha.jar
> */usr/lib/hadoop2/share/hadoop/common/hadoop-common-2.0.2-alpha-sources.jar*
> /usr/lib/hadoop2/share/hadoop/common/lib/hadoop-auth-2.0.2-alpha.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/guava-11.0.2.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/protobuf-java-2.4.0a.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/commons-configuration-1.6.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/commons-cli-1.2.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/commons-logging-1.1.1.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/slf4j-api-1.6.1.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar
> /usr/lib/hadoop2/share/hadoop/common/lib/avro-1.5.3.jar
> 
> Backing up original WAR file to
> ./../server/webapps/sqoop.war_2013-02-15_19:20:06.784011030
> 
> New Sqoop WAR file with added 'Hadoop JARs' at ./../server/webapps/sqoop.war
> 
> ---------------------------------------------------------------------------------------------------
> 
> 
> Is it defect or I should use only hadoop 2.0 binary version only?
> 
> -- 
> Regards
> Vasanth kumar RJ