You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2015/02/28 07:44:14 UTC
spark git commit: [SPARK-6070] [yarn] Remove unneeded classes from
shuffle service jar.
Repository: spark
Updated Branches:
refs/heads/master e0e64ba4b -> dba08d1fc
[SPARK-6070] [yarn] Remove unneeded classes from shuffle service jar.
These may conflict with the classes already in the NM. We shouldn't
be repackaging them.
Author: Marcelo Vanzin <va...@cloudera.com>
Closes #4820 from vanzin/SPARK-6070 and squashes the following commits:
871b566 [Marcelo Vanzin] The "d'oh how didn't I think of it before" solution.
3cba946 [Marcelo Vanzin] Use profile instead, so that dependencies don't need to be explicitly listed.
7a18a1b [Marcelo Vanzin] [SPARK-6070] [yarn] Remove unneeded classes from shuffle service jar.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dba08d1f
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/dba08d1f
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/dba08d1f
Branch: refs/heads/master
Commit: dba08d1fc3bdb9245aefe695970354df088a93b6
Parents: e0e64ba
Author: Marcelo Vanzin <va...@cloudera.com>
Authored: Fri Feb 27 22:44:11 2015 -0800
Committer: Patrick Wendell <pa...@databricks.com>
Committed: Fri Feb 27 22:44:11 2015 -0800
----------------------------------------------------------------------
network/yarn/pom.xml | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/dba08d1f/network/yarn/pom.xml
----------------------------------------------------------------------
diff --git a/network/yarn/pom.xml b/network/yarn/pom.xml
index acec8f1..39b99f5 100644
--- a/network/yarn/pom.xml
+++ b/network/yarn/pom.xml
@@ -33,6 +33,8 @@
<url>http://spark.apache.org/</url>
<properties>
<sbt.project.name>network-yarn</sbt.project.name>
+ <!-- Make sure all Hadoop dependencies are provided to avoid repackaging. -->
+ <hadoop.deps.scope>provided</hadoop.deps.scope>
</properties>
<dependencies>
@@ -47,7 +49,6 @@
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
- <scope>provided</scope>
</dependency>
</dependencies>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org