You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Alejandro Abdelnur (JIRA)" <ji...@apache.org> on 2012/06/20 18:34:43 UTC
[jira] [Created] (OOZIE-876) distcp packaging with Hadoop 1 brings
in lots of unwanted dependencies
Alejandro Abdelnur created OOZIE-876:
----------------------------------------
Summary: distcp packaging with Hadoop 1 brings in lots of unwanted dependencies
Key: OOZIE-876
URL: https://issues.apache.org/jira/browse/OOZIE-876
Project: Oozie
Issue Type: Bug
Components: build
Affects Versions: trunk
Reporter: Alejandro Abdelnur
Assignee: Robert Kanter
Fix For: trunk
Checking a built of Oozie using Hadoop 1 I've noticed the sharelib for distcp brings a lot of unwanted JARs:
{code}
-rw-r--r-- 0 tucu staff 1034049 Jun 20 09:26 share/lib/distcp/ant-1.6.5.jar
-rw-r--r-- 0 tucu staff 188671 Jun 20 09:26 share/lib/distcp/commons-beanutils-1.7.0.jar
-rw-r--r-- 0 tucu staff 206035 Jun 20 09:26 share/lib/distcp/commons-beanutils-core-1.8.0.jar
-rw-r--r-- 0 tucu staff 41123 Jun 20 09:26 share/lib/distcp/commons-cli-1.2.jar
-rw-r--r-- 0 tucu staff 58160 Jun 20 09:26 share/lib/distcp/commons-codec-1.4.jar
-rw-r--r-- 0 tucu staff 575389 Jun 20 09:26 share/lib/distcp/commons-collections-3.2.1.jar
-rw-r--r-- 0 tucu staff 298829 Jun 20 09:26 share/lib/distcp/commons-configuration-1.6.jar
-rw-r--r-- 0 tucu staff 143602 Jun 20 09:26 share/lib/distcp/commons-digester-1.8.jar
-rw-r--r-- 0 tucu staff 112341 Jun 20 09:26 share/lib/distcp/commons-el-1.0.jar
-rw-r--r-- 0 tucu staff 279781 Jun 20 09:26 share/lib/distcp/commons-httpclient-3.0.1.jar
-rw-r--r-- 0 tucu staff 261809 Jun 20 09:26 share/lib/distcp/commons-lang-2.4.jar
-rw-r--r-- 0 tucu staff 52915 Jun 20 09:26 share/lib/distcp/commons-logging-1.1.jar
-rw-r--r-- 0 tucu staff 832410 Jun 20 09:26 share/lib/distcp/commons-math-2.1.jar
-rw-r--r-- 0 tucu staff 180792 Jun 20 09:26 share/lib/distcp/commons-net-1.4.1.jar
-rw-r--r-- 0 tucu staff 3566844 Jun 20 09:26 share/lib/distcp/core-3.1.1.jar
-rw-r--r-- 0 tucu staff 3909356 Jun 20 09:26 share/lib/distcp/hadoop-core-1.0.1.jar
-rw-r--r-- 0 tucu staff 76643 Jun 20 09:26 share/lib/distcp/hamcrest-core-1.1.jar
-rw-r--r-- 0 tucu staff 643727 Jun 20 09:26 share/lib/distcp/hsqldb-1.8.0.7.jar
-rw-r--r-- 0 tucu staff 136059 Jun 20 09:26 share/lib/distcp/jackson-core-asl-1.0.1.jar
-rw-r--r-- 0 tucu staff 270781 Jun 20 09:26 share/lib/distcp/jackson-mapper-asl-1.0.1.jar
-rw-r--r-- 0 tucu staff 405086 Jun 20 09:26 share/lib/distcp/jasper-compiler-5.5.12.jar
-rw-r--r-- 0 tucu staff 76698 Jun 20 09:26 share/lib/distcp/jasper-runtime-5.5.12.jar
-rw-r--r-- 0 tucu staff 377780 Jun 20 09:26 share/lib/distcp/jets3t-0.7.1.jar
-rw-r--r-- 0 tucu staff 516429 Jun 20 09:26 share/lib/distcp/jetty-6.1.14.jar
-rw-r--r-- 0 tucu staff 177131 Jun 20 09:26 share/lib/distcp/jetty-util-6.1.26.jar
-rw-r--r-- 0 tucu staff 1024680 Jun 20 09:26 share/lib/distcp/jsp-2.1-6.1.14.jar
-rw-r--r-- 0 tucu staff 134910 Jun 20 09:26 share/lib/distcp/jsp-api-2.1-6.1.14.jar
-rw-r--r-- 0 tucu staff 253160 Jun 20 09:26 share/lib/distcp/junit-4.10.jar
-rw-r--r-- 0 tucu staff 11981 Jun 20 09:26 share/lib/distcp/kfs-0.3.jar
-rw-r--r-- 0 tucu staff 481535 Jun 20 09:26 share/lib/distcp/log4j-1.2.16.jar
-rw-r--r-- 0 tucu staff 2139 Jun 20 09:26 share/lib/distcp/oozie-hadoop-distcp-1.0.1.oozie-3.3.0-SNAPSHOT.jar
-rw-r--r-- 0 tucu staff 65261 Jun 20 09:26 share/lib/distcp/oro-2.0.8.jar
-rw-r--r-- 0 tucu staff 132368 Jun 20 09:26 share/lib/distcp/servlet-api-2.5-6.1.14.jar
-rw-r--r-- 0 tucu staff 15010 Jun 20 09:26 share/lib/distcp/xmlenc-0.52.jar
{code}
We should get the hadoop-distcp-1 POM to exclude all those. Hadoop2 does not have this problem (POMs from Hadoop are proper)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-876) distcp packaging with Hadoop 1
brings in lots of unwanted dependencies
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397831#comment-13397831 ]
Alejandro Abdelnur commented on OOZIE-876:
------------------------------------------
almost there, it seems we have to filter the fake oozie-hadoop-distcp JAR out of the sharelib assembly. For this we'll have to tweak the sharelib assembly to exclude oozie-hadoop-distcp.
> distcp packaging with Hadoop 1 brings in lots of unwanted dependencies
> ----------------------------------------------------------------------
>
> Key: OOZIE-876
> URL: https://issues.apache.org/jira/browse/OOZIE-876
> Project: Oozie
> Issue Type: Bug
> Components: build
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Robert Kanter
> Fix For: trunk
>
> Attachments: OOZIE-876.patch
>
>
> Checking a built of Oozie using Hadoop 1 I've noticed the sharelib for distcp brings a lot of unwanted JARs:
> {code}
> -rw-r--r-- 0 tucu staff 1034049 Jun 20 09:26 share/lib/distcp/ant-1.6.5.jar
> -rw-r--r-- 0 tucu staff 188671 Jun 20 09:26 share/lib/distcp/commons-beanutils-1.7.0.jar
> -rw-r--r-- 0 tucu staff 206035 Jun 20 09:26 share/lib/distcp/commons-beanutils-core-1.8.0.jar
> -rw-r--r-- 0 tucu staff 41123 Jun 20 09:26 share/lib/distcp/commons-cli-1.2.jar
> -rw-r--r-- 0 tucu staff 58160 Jun 20 09:26 share/lib/distcp/commons-codec-1.4.jar
> -rw-r--r-- 0 tucu staff 575389 Jun 20 09:26 share/lib/distcp/commons-collections-3.2.1.jar
> -rw-r--r-- 0 tucu staff 298829 Jun 20 09:26 share/lib/distcp/commons-configuration-1.6.jar
> -rw-r--r-- 0 tucu staff 143602 Jun 20 09:26 share/lib/distcp/commons-digester-1.8.jar
> -rw-r--r-- 0 tucu staff 112341 Jun 20 09:26 share/lib/distcp/commons-el-1.0.jar
> -rw-r--r-- 0 tucu staff 279781 Jun 20 09:26 share/lib/distcp/commons-httpclient-3.0.1.jar
> -rw-r--r-- 0 tucu staff 261809 Jun 20 09:26 share/lib/distcp/commons-lang-2.4.jar
> -rw-r--r-- 0 tucu staff 52915 Jun 20 09:26 share/lib/distcp/commons-logging-1.1.jar
> -rw-r--r-- 0 tucu staff 832410 Jun 20 09:26 share/lib/distcp/commons-math-2.1.jar
> -rw-r--r-- 0 tucu staff 180792 Jun 20 09:26 share/lib/distcp/commons-net-1.4.1.jar
> -rw-r--r-- 0 tucu staff 3566844 Jun 20 09:26 share/lib/distcp/core-3.1.1.jar
> -rw-r--r-- 0 tucu staff 3909356 Jun 20 09:26 share/lib/distcp/hadoop-core-1.0.1.jar
> -rw-r--r-- 0 tucu staff 76643 Jun 20 09:26 share/lib/distcp/hamcrest-core-1.1.jar
> -rw-r--r-- 0 tucu staff 643727 Jun 20 09:26 share/lib/distcp/hsqldb-1.8.0.7.jar
> -rw-r--r-- 0 tucu staff 136059 Jun 20 09:26 share/lib/distcp/jackson-core-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 270781 Jun 20 09:26 share/lib/distcp/jackson-mapper-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 405086 Jun 20 09:26 share/lib/distcp/jasper-compiler-5.5.12.jar
> -rw-r--r-- 0 tucu staff 76698 Jun 20 09:26 share/lib/distcp/jasper-runtime-5.5.12.jar
> -rw-r--r-- 0 tucu staff 377780 Jun 20 09:26 share/lib/distcp/jets3t-0.7.1.jar
> -rw-r--r-- 0 tucu staff 516429 Jun 20 09:26 share/lib/distcp/jetty-6.1.14.jar
> -rw-r--r-- 0 tucu staff 177131 Jun 20 09:26 share/lib/distcp/jetty-util-6.1.26.jar
> -rw-r--r-- 0 tucu staff 1024680 Jun 20 09:26 share/lib/distcp/jsp-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 134910 Jun 20 09:26 share/lib/distcp/jsp-api-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 253160 Jun 20 09:26 share/lib/distcp/junit-4.10.jar
> -rw-r--r-- 0 tucu staff 11981 Jun 20 09:26 share/lib/distcp/kfs-0.3.jar
> -rw-r--r-- 0 tucu staff 481535 Jun 20 09:26 share/lib/distcp/log4j-1.2.16.jar
> -rw-r--r-- 0 tucu staff 2139 Jun 20 09:26 share/lib/distcp/oozie-hadoop-distcp-1.0.1.oozie-3.3.0-SNAPSHOT.jar
> -rw-r--r-- 0 tucu staff 65261 Jun 20 09:26 share/lib/distcp/oro-2.0.8.jar
> -rw-r--r-- 0 tucu staff 132368 Jun 20 09:26 share/lib/distcp/servlet-api-2.5-6.1.14.jar
> -rw-r--r-- 0 tucu staff 15010 Jun 20 09:26 share/lib/distcp/xmlenc-0.52.jar
> {code}
> We should get the hadoop-distcp-1 POM to exclude all those. Hadoop2 does not have this problem (POMs from Hadoop are proper)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OOZIE-876) distcp packaging with Hadoop 1 brings
in lots of unwanted dependencies
Posted by "Robert Kanter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Kanter updated OOZIE-876:
--------------------------------
Attachment: OOZIE-876v2.patch
> distcp packaging with Hadoop 1 brings in lots of unwanted dependencies
> ----------------------------------------------------------------------
>
> Key: OOZIE-876
> URL: https://issues.apache.org/jira/browse/OOZIE-876
> Project: Oozie
> Issue Type: Bug
> Components: build
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Robert Kanter
> Fix For: trunk
>
> Attachments: OOZIE-876.patch, OOZIE-876v2.patch
>
>
> Checking a built of Oozie using Hadoop 1 I've noticed the sharelib for distcp brings a lot of unwanted JARs:
> {code}
> -rw-r--r-- 0 tucu staff 1034049 Jun 20 09:26 share/lib/distcp/ant-1.6.5.jar
> -rw-r--r-- 0 tucu staff 188671 Jun 20 09:26 share/lib/distcp/commons-beanutils-1.7.0.jar
> -rw-r--r-- 0 tucu staff 206035 Jun 20 09:26 share/lib/distcp/commons-beanutils-core-1.8.0.jar
> -rw-r--r-- 0 tucu staff 41123 Jun 20 09:26 share/lib/distcp/commons-cli-1.2.jar
> -rw-r--r-- 0 tucu staff 58160 Jun 20 09:26 share/lib/distcp/commons-codec-1.4.jar
> -rw-r--r-- 0 tucu staff 575389 Jun 20 09:26 share/lib/distcp/commons-collections-3.2.1.jar
> -rw-r--r-- 0 tucu staff 298829 Jun 20 09:26 share/lib/distcp/commons-configuration-1.6.jar
> -rw-r--r-- 0 tucu staff 143602 Jun 20 09:26 share/lib/distcp/commons-digester-1.8.jar
> -rw-r--r-- 0 tucu staff 112341 Jun 20 09:26 share/lib/distcp/commons-el-1.0.jar
> -rw-r--r-- 0 tucu staff 279781 Jun 20 09:26 share/lib/distcp/commons-httpclient-3.0.1.jar
> -rw-r--r-- 0 tucu staff 261809 Jun 20 09:26 share/lib/distcp/commons-lang-2.4.jar
> -rw-r--r-- 0 tucu staff 52915 Jun 20 09:26 share/lib/distcp/commons-logging-1.1.jar
> -rw-r--r-- 0 tucu staff 832410 Jun 20 09:26 share/lib/distcp/commons-math-2.1.jar
> -rw-r--r-- 0 tucu staff 180792 Jun 20 09:26 share/lib/distcp/commons-net-1.4.1.jar
> -rw-r--r-- 0 tucu staff 3566844 Jun 20 09:26 share/lib/distcp/core-3.1.1.jar
> -rw-r--r-- 0 tucu staff 3909356 Jun 20 09:26 share/lib/distcp/hadoop-core-1.0.1.jar
> -rw-r--r-- 0 tucu staff 76643 Jun 20 09:26 share/lib/distcp/hamcrest-core-1.1.jar
> -rw-r--r-- 0 tucu staff 643727 Jun 20 09:26 share/lib/distcp/hsqldb-1.8.0.7.jar
> -rw-r--r-- 0 tucu staff 136059 Jun 20 09:26 share/lib/distcp/jackson-core-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 270781 Jun 20 09:26 share/lib/distcp/jackson-mapper-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 405086 Jun 20 09:26 share/lib/distcp/jasper-compiler-5.5.12.jar
> -rw-r--r-- 0 tucu staff 76698 Jun 20 09:26 share/lib/distcp/jasper-runtime-5.5.12.jar
> -rw-r--r-- 0 tucu staff 377780 Jun 20 09:26 share/lib/distcp/jets3t-0.7.1.jar
> -rw-r--r-- 0 tucu staff 516429 Jun 20 09:26 share/lib/distcp/jetty-6.1.14.jar
> -rw-r--r-- 0 tucu staff 177131 Jun 20 09:26 share/lib/distcp/jetty-util-6.1.26.jar
> -rw-r--r-- 0 tucu staff 1024680 Jun 20 09:26 share/lib/distcp/jsp-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 134910 Jun 20 09:26 share/lib/distcp/jsp-api-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 253160 Jun 20 09:26 share/lib/distcp/junit-4.10.jar
> -rw-r--r-- 0 tucu staff 11981 Jun 20 09:26 share/lib/distcp/kfs-0.3.jar
> -rw-r--r-- 0 tucu staff 481535 Jun 20 09:26 share/lib/distcp/log4j-1.2.16.jar
> -rw-r--r-- 0 tucu staff 2139 Jun 20 09:26 share/lib/distcp/oozie-hadoop-distcp-1.0.1.oozie-3.3.0-SNAPSHOT.jar
> -rw-r--r-- 0 tucu staff 65261 Jun 20 09:26 share/lib/distcp/oro-2.0.8.jar
> -rw-r--r-- 0 tucu staff 132368 Jun 20 09:26 share/lib/distcp/servlet-api-2.5-6.1.14.jar
> -rw-r--r-- 0 tucu staff 15010 Jun 20 09:26 share/lib/distcp/xmlenc-0.52.jar
> {code}
> We should get the hadoop-distcp-1 POM to exclude all those. Hadoop2 does not have this problem (POMs from Hadoop are proper)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OOZIE-876) distcp packaging with Hadoop 1 brings
in lots of unwanted dependencies
Posted by "Robert Kanter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Kanter updated OOZIE-876:
--------------------------------
Attachment: OOZIE-876.patch
distcp only needs the hadoop-tools-1.0.1.jar and excluding hadoop-core actually removes all of the other ones too :)
> distcp packaging with Hadoop 1 brings in lots of unwanted dependencies
> ----------------------------------------------------------------------
>
> Key: OOZIE-876
> URL: https://issues.apache.org/jira/browse/OOZIE-876
> Project: Oozie
> Issue Type: Bug
> Components: build
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Robert Kanter
> Fix For: trunk
>
> Attachments: OOZIE-876.patch
>
>
> Checking a built of Oozie using Hadoop 1 I've noticed the sharelib for distcp brings a lot of unwanted JARs:
> {code}
> -rw-r--r-- 0 tucu staff 1034049 Jun 20 09:26 share/lib/distcp/ant-1.6.5.jar
> -rw-r--r-- 0 tucu staff 188671 Jun 20 09:26 share/lib/distcp/commons-beanutils-1.7.0.jar
> -rw-r--r-- 0 tucu staff 206035 Jun 20 09:26 share/lib/distcp/commons-beanutils-core-1.8.0.jar
> -rw-r--r-- 0 tucu staff 41123 Jun 20 09:26 share/lib/distcp/commons-cli-1.2.jar
> -rw-r--r-- 0 tucu staff 58160 Jun 20 09:26 share/lib/distcp/commons-codec-1.4.jar
> -rw-r--r-- 0 tucu staff 575389 Jun 20 09:26 share/lib/distcp/commons-collections-3.2.1.jar
> -rw-r--r-- 0 tucu staff 298829 Jun 20 09:26 share/lib/distcp/commons-configuration-1.6.jar
> -rw-r--r-- 0 tucu staff 143602 Jun 20 09:26 share/lib/distcp/commons-digester-1.8.jar
> -rw-r--r-- 0 tucu staff 112341 Jun 20 09:26 share/lib/distcp/commons-el-1.0.jar
> -rw-r--r-- 0 tucu staff 279781 Jun 20 09:26 share/lib/distcp/commons-httpclient-3.0.1.jar
> -rw-r--r-- 0 tucu staff 261809 Jun 20 09:26 share/lib/distcp/commons-lang-2.4.jar
> -rw-r--r-- 0 tucu staff 52915 Jun 20 09:26 share/lib/distcp/commons-logging-1.1.jar
> -rw-r--r-- 0 tucu staff 832410 Jun 20 09:26 share/lib/distcp/commons-math-2.1.jar
> -rw-r--r-- 0 tucu staff 180792 Jun 20 09:26 share/lib/distcp/commons-net-1.4.1.jar
> -rw-r--r-- 0 tucu staff 3566844 Jun 20 09:26 share/lib/distcp/core-3.1.1.jar
> -rw-r--r-- 0 tucu staff 3909356 Jun 20 09:26 share/lib/distcp/hadoop-core-1.0.1.jar
> -rw-r--r-- 0 tucu staff 76643 Jun 20 09:26 share/lib/distcp/hamcrest-core-1.1.jar
> -rw-r--r-- 0 tucu staff 643727 Jun 20 09:26 share/lib/distcp/hsqldb-1.8.0.7.jar
> -rw-r--r-- 0 tucu staff 136059 Jun 20 09:26 share/lib/distcp/jackson-core-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 270781 Jun 20 09:26 share/lib/distcp/jackson-mapper-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 405086 Jun 20 09:26 share/lib/distcp/jasper-compiler-5.5.12.jar
> -rw-r--r-- 0 tucu staff 76698 Jun 20 09:26 share/lib/distcp/jasper-runtime-5.5.12.jar
> -rw-r--r-- 0 tucu staff 377780 Jun 20 09:26 share/lib/distcp/jets3t-0.7.1.jar
> -rw-r--r-- 0 tucu staff 516429 Jun 20 09:26 share/lib/distcp/jetty-6.1.14.jar
> -rw-r--r-- 0 tucu staff 177131 Jun 20 09:26 share/lib/distcp/jetty-util-6.1.26.jar
> -rw-r--r-- 0 tucu staff 1024680 Jun 20 09:26 share/lib/distcp/jsp-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 134910 Jun 20 09:26 share/lib/distcp/jsp-api-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 253160 Jun 20 09:26 share/lib/distcp/junit-4.10.jar
> -rw-r--r-- 0 tucu staff 11981 Jun 20 09:26 share/lib/distcp/kfs-0.3.jar
> -rw-r--r-- 0 tucu staff 481535 Jun 20 09:26 share/lib/distcp/log4j-1.2.16.jar
> -rw-r--r-- 0 tucu staff 2139 Jun 20 09:26 share/lib/distcp/oozie-hadoop-distcp-1.0.1.oozie-3.3.0-SNAPSHOT.jar
> -rw-r--r-- 0 tucu staff 65261 Jun 20 09:26 share/lib/distcp/oro-2.0.8.jar
> -rw-r--r-- 0 tucu staff 132368 Jun 20 09:26 share/lib/distcp/servlet-api-2.5-6.1.14.jar
> -rw-r--r-- 0 tucu staff 15010 Jun 20 09:26 share/lib/distcp/xmlenc-0.52.jar
> {code}
> We should get the hadoop-distcp-1 POM to exclude all those. Hadoop2 does not have this problem (POMs from Hadoop are proper)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-876) distcp packaging with Hadoop 1
brings in lots of unwanted dependencies
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397852#comment-13397852 ]
Alejandro Abdelnur commented on OOZIE-876:
------------------------------------------
+1
> distcp packaging with Hadoop 1 brings in lots of unwanted dependencies
> ----------------------------------------------------------------------
>
> Key: OOZIE-876
> URL: https://issues.apache.org/jira/browse/OOZIE-876
> Project: Oozie
> Issue Type: Bug
> Components: build
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Robert Kanter
> Fix For: trunk
>
> Attachments: OOZIE-876.patch, OOZIE-876v2.patch
>
>
> Checking a built of Oozie using Hadoop 1 I've noticed the sharelib for distcp brings a lot of unwanted JARs:
> {code}
> -rw-r--r-- 0 tucu staff 1034049 Jun 20 09:26 share/lib/distcp/ant-1.6.5.jar
> -rw-r--r-- 0 tucu staff 188671 Jun 20 09:26 share/lib/distcp/commons-beanutils-1.7.0.jar
> -rw-r--r-- 0 tucu staff 206035 Jun 20 09:26 share/lib/distcp/commons-beanutils-core-1.8.0.jar
> -rw-r--r-- 0 tucu staff 41123 Jun 20 09:26 share/lib/distcp/commons-cli-1.2.jar
> -rw-r--r-- 0 tucu staff 58160 Jun 20 09:26 share/lib/distcp/commons-codec-1.4.jar
> -rw-r--r-- 0 tucu staff 575389 Jun 20 09:26 share/lib/distcp/commons-collections-3.2.1.jar
> -rw-r--r-- 0 tucu staff 298829 Jun 20 09:26 share/lib/distcp/commons-configuration-1.6.jar
> -rw-r--r-- 0 tucu staff 143602 Jun 20 09:26 share/lib/distcp/commons-digester-1.8.jar
> -rw-r--r-- 0 tucu staff 112341 Jun 20 09:26 share/lib/distcp/commons-el-1.0.jar
> -rw-r--r-- 0 tucu staff 279781 Jun 20 09:26 share/lib/distcp/commons-httpclient-3.0.1.jar
> -rw-r--r-- 0 tucu staff 261809 Jun 20 09:26 share/lib/distcp/commons-lang-2.4.jar
> -rw-r--r-- 0 tucu staff 52915 Jun 20 09:26 share/lib/distcp/commons-logging-1.1.jar
> -rw-r--r-- 0 tucu staff 832410 Jun 20 09:26 share/lib/distcp/commons-math-2.1.jar
> -rw-r--r-- 0 tucu staff 180792 Jun 20 09:26 share/lib/distcp/commons-net-1.4.1.jar
> -rw-r--r-- 0 tucu staff 3566844 Jun 20 09:26 share/lib/distcp/core-3.1.1.jar
> -rw-r--r-- 0 tucu staff 3909356 Jun 20 09:26 share/lib/distcp/hadoop-core-1.0.1.jar
> -rw-r--r-- 0 tucu staff 76643 Jun 20 09:26 share/lib/distcp/hamcrest-core-1.1.jar
> -rw-r--r-- 0 tucu staff 643727 Jun 20 09:26 share/lib/distcp/hsqldb-1.8.0.7.jar
> -rw-r--r-- 0 tucu staff 136059 Jun 20 09:26 share/lib/distcp/jackson-core-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 270781 Jun 20 09:26 share/lib/distcp/jackson-mapper-asl-1.0.1.jar
> -rw-r--r-- 0 tucu staff 405086 Jun 20 09:26 share/lib/distcp/jasper-compiler-5.5.12.jar
> -rw-r--r-- 0 tucu staff 76698 Jun 20 09:26 share/lib/distcp/jasper-runtime-5.5.12.jar
> -rw-r--r-- 0 tucu staff 377780 Jun 20 09:26 share/lib/distcp/jets3t-0.7.1.jar
> -rw-r--r-- 0 tucu staff 516429 Jun 20 09:26 share/lib/distcp/jetty-6.1.14.jar
> -rw-r--r-- 0 tucu staff 177131 Jun 20 09:26 share/lib/distcp/jetty-util-6.1.26.jar
> -rw-r--r-- 0 tucu staff 1024680 Jun 20 09:26 share/lib/distcp/jsp-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 134910 Jun 20 09:26 share/lib/distcp/jsp-api-2.1-6.1.14.jar
> -rw-r--r-- 0 tucu staff 253160 Jun 20 09:26 share/lib/distcp/junit-4.10.jar
> -rw-r--r-- 0 tucu staff 11981 Jun 20 09:26 share/lib/distcp/kfs-0.3.jar
> -rw-r--r-- 0 tucu staff 481535 Jun 20 09:26 share/lib/distcp/log4j-1.2.16.jar
> -rw-r--r-- 0 tucu staff 2139 Jun 20 09:26 share/lib/distcp/oozie-hadoop-distcp-1.0.1.oozie-3.3.0-SNAPSHOT.jar
> -rw-r--r-- 0 tucu staff 65261 Jun 20 09:26 share/lib/distcp/oro-2.0.8.jar
> -rw-r--r-- 0 tucu staff 132368 Jun 20 09:26 share/lib/distcp/servlet-api-2.5-6.1.14.jar
> -rw-r--r-- 0 tucu staff 15010 Jun 20 09:26 share/lib/distcp/xmlenc-0.52.jar
> {code}
> We should get the hadoop-distcp-1 POM to exclude all those. Hadoop2 does not have this problem (POMs from Hadoop are proper)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira