You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2015/07/08 13:23:15 UTC
spark git commit: [SPARK-7050] [BUILD] Fix Python Kafka test assembly
jar not found issue under Maven build
Repository: spark
Updated Branches:
refs/heads/master 351a36d0c -> 8a9d9cc15
[SPARK-7050] [BUILD] Fix Python Kafka test assembly jar not found issue under Maven build
To fix Spark Streaming unit test with maven build. Previously the name and path of maven generated jar is different from sbt, which will lead to following exception. This fix keep the same behavior with both Maven and sbt build.
```
Failed to find Spark Streaming Kafka assembly jar in /home/xyz/spark/external/kafka-assembly
You need to build Spark with 'build/sbt assembly/assembly streaming-kafka-assembly/assembly' or 'build/mvn package' before running this program
```
Author: jerryshao <sa...@intel.com>
Closes #5632 from jerryshao/SPARK-7050 and squashes the following commits:
74b068d [jerryshao] Fix mvn build issue
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8a9d9cc1
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8a9d9cc1
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8a9d9cc1
Branch: refs/heads/master
Commit: 8a9d9cc1561cf157793c90db6700ffa6f1f00a69
Parents: 351a36d
Author: jerryshao <sa...@intel.com>
Authored: Wed Jul 8 12:23:32 2015 +0100
Committer: Sean Owen <so...@cloudera.com>
Committed: Wed Jul 8 12:23:32 2015 +0100
----------------------------------------------------------------------
external/kafka-assembly/pom.xml | 1 +
1 file changed, 1 insertion(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/8a9d9cc1/external/kafka-assembly/pom.xml
----------------------------------------------------------------------
diff --git a/external/kafka-assembly/pom.xml b/external/kafka-assembly/pom.xml
index 8059c44..977514f 100644
--- a/external/kafka-assembly/pom.xml
+++ b/external/kafka-assembly/pom.xml
@@ -58,6 +58,7 @@
<artifactId>maven-shade-plugin</artifactId>
<configuration>
<shadedArtifactAttached>false</shadedArtifactAttached>
+ <outputFile>${project.build.directory}/scala-${scala.binary.version}/spark-streaming-kafka-assembly-${project.version}.jar</outputFile>
<artifactSet>
<includes>
<include>*:*</include>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org