You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2016/06/09 08:02:21 UTC
[jira] [Resolved] (SPARK-12712) test-dependencies.sh script fails
when run against empty .m2 cache
[ https://issues.apache.org/jira/browse/SPARK-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Josh Rosen resolved SPARK-12712.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.6.2
2.0.0
Issue resolved by pull request 13568
[https://github.com/apache/spark/pull/13568]
> test-dependencies.sh script fails when run against empty .m2 cache
> ------------------------------------------------------------------
>
> Key: SPARK-12712
> URL: https://issues.apache.org/jira/browse/SPARK-12712
> Project: Spark
> Issue Type: Bug
> Components: Project Infra
> Reporter: Stavros Kontopoulos
> Assignee: Josh Rosen
> Fix For: 2.0.0, 1.6.2
>
>
> Test-dependencies.sh script fails.
> This relates to this https://github.com/apache/spark/pull/10461
> Check failure here:
> https://ci.typesafe.com/job/ghprb-spark-multi-conf/label=Spark-Ora-JDK7-PV,scala_version=2.10/84/console
> My pr does not change dependencies shouldnt the pr manifest be generated with full dependencies it seems empty. should i use replace-manifest?
> Reproducing it locally on that jenkins instance i get this:
> Spark's published dependencies DO NOT MATCH the manifest file (dev/spark-deps).
> To update the manifest file, run './dev/test-dependencies.sh --replace-manifest'.
> diff --git a/dev/deps/spark-deps-hadoop-2.6 b/dev/pr-deps/spark-deps-hadoop-2.6
> index e703c7a..3aa2c38 100644
> --- a/dev/deps/spark-deps-hadoop-2.6
> +++ b/dev/pr-deps/spark-deps-hadoop-2.6
> @@ -1,190 +1,2 @@
> -JavaEWAH-0.3.2.jar
> -RoaringBitmap-0.5.11.jar
> -ST4-4.0.4.jar
> -activation-1.1.1.jar
> -akka-actor_2.10-2.3.11.jar
> -akka-remote_2.10-2.3.11.jar
> -akka-slf4j_2.10-2.3.11.jar
> -antlr-runtime-3.5.2.jar
> -aopalliance-1.0.jar
> -apache-log4j-extras-1.2.17.jar
> -apacheds-i18n-2.0.0-M15.jar
> -apacheds-kerberos-codec-2.0.0-M15.jar
> -api-asn1-api-1.0.0-M20.jar
> -api-util-1.0.0-M20.jar
> -arpack_combined_all-0.1.jar
> -asm-3.1.jar
> -asm-commons-3.1.jar
> -asm-tree-3.1.jar
> -avro-1.7.7.jar
> -avro-ipc-1.7.7-tests.jar
> -avro-ipc-1.7.7.jar
> -avro-mapred-1.7.7-hadoop2.jar
> -base64-2.3.8.jar
> -bcprov-jdk15on-1.51.jar
> -bonecp-0.8.0.RELEASE.jar
> -breeze-macros_2.10-0.11.2.jar
> -breeze_2.10-0.11.2.jar
> -calcite-avatica-1.2.0-incubating.jar
> -calcite-core-1.2.0-incubating.jar
> -calcite-linq4j-1.2.0-incubating.jar
> -chill-java-0.5.0.jar
> -chill_2.10-0.5.0.jar
> -commons-beanutils-1.7.0.jar
> -commons-beanutils-core-1.8.0.jar
> -commons-cli-1.2.jar
> -commons-codec-1.10.jar
> -commons-collections-3.2.2.jar
> -commons-compiler-2.7.6.jar
> -commons-compress-1.4.1.jar
> -commons-configuration-1.6.jar
> -commons-dbcp-1.4.jar
> -commons-digester-1.8.jar
> -commons-httpclient-3.1.jar
> -commons-io-2.4.jar
> -commons-lang-2.6.jar
> -commons-lang3-3.3.2.jar
> -commons-logging-1.1.3.jar
> -commons-math3-3.4.1.jar
> -commons-net-2.2.jar
> -commons-pool-1.5.4.jar
> -compress-lzf-1.0.3.jar
> -config-1.2.1.jar
> -core-1.1.2.jar
> -curator-client-2.6.0.jar
> -curator-framework-2.6.0.jar
> -curator-recipes-2.6.0.jar
> -datanucleus-api-jdo-3.2.6.jar
> -datanucleus-core-3.2.10.jar
> -datanucleus-rdbms-3.2.9.jar
> -derby-10.10.1.1.jar
> -eigenbase-properties-1.1.5.jar
> -geronimo-annotation_1.0_spec-1.1.1.jar
> -geronimo-jaspic_1.0_spec-1.0.jar
> -geronimo-jta_1.1_spec-1.1.1.jar
> -groovy-all-2.1.6.jar
> -gson-2.2.4.jar
> -guice-3.0.jar
> -guice-servlet-3.0.jar
> -hadoop-annotations-2.6.0.jar
> -hadoop-auth-2.6.0.jar
> -hadoop-client-2.6.0.jar
> -hadoop-common-2.6.0.jar
> -hadoop-hdfs-2.6.0.jar
> -hadoop-mapreduce-client-app-2.6.0.jar
> -hadoop-mapreduce-client-common-2.6.0.jar
> -hadoop-mapreduce-client-core-2.6.0.jar
> -hadoop-mapreduce-client-jobclient-2.6.0.jar
> -hadoop-mapreduce-client-shuffle-2.6.0.jar
> -hadoop-yarn-api-2.6.0.jar
> -hadoop-yarn-client-2.6.0.jar
> -hadoop-yarn-common-2.6.0.jar
> -hadoop-yarn-server-common-2.6.0.jar
> -hadoop-yarn-server-web-proxy-2.6.0.jar
> -htrace-core-3.0.4.jar
> -httpclient-4.3.2.jar
> -httpcore-4.3.2.jar
> -ivy-2.4.0.jar
> -jackson-annotations-2.4.4.jar
> -jackson-core-2.4.4.jar
> -jackson-core-asl-1.9.13.jar
> -jackson-databind-2.4.4.jar
> -jackson-jaxrs-1.9.13.jar
> -jackson-mapper-asl-1.9.13.jar
> -jackson-module-scala_2.10-2.4.4.jar
> -jackson-xc-1.9.13.jar
> -janino-2.7.8.jar
> -jansi-1.4.jar
> -java-xmlbuilder-1.0.jar
> -javax.inject-1.jar
> -javax.servlet-3.0.0.v201112011016.jar
> -javolution-5.5.1.jar
> -jaxb-api-2.2.2.jar
> -jaxb-impl-2.2.3-1.jar
> -jcl-over-slf4j-1.7.10.jar
> -jdo-api-3.0.1.jar
> -jersey-client-1.9.jar
> -jersey-core-1.9.jar
> -jersey-guice-1.9.jar
> -jersey-json-1.9.jar
> -jersey-server-1.9.jar
> -jets3t-0.9.3.jar
> -jettison-1.1.jar
> -jetty-6.1.26.jar
> -jetty-all-7.6.0.v20120127.jar
> -jetty-util-6.1.26.jar
> -jline-2.10.5.jar
> -jline-2.12.jar
> -joda-time-2.9.jar
> -jodd-core-3.5.2.jar
> -jpam-1.1.jar
> -json-20090211.jar
> -json4s-ast_2.10-3.2.10.jar
> -json4s-core_2.10-3.2.10.jar
> -json4s-jackson_2.10-3.2.10.jar
> -jsr305-1.3.9.jar
> -jta-1.1.jar
> -jtransforms-2.4.0.jar
> -jul-to-slf4j-1.7.10.jar
> -kryo-2.21.jar
> -leveldbjni-all-1.8.jar
> -libfb303-0.9.2.jar
> -libthrift-0.9.2.jar
> -log4j-1.2.17.jar
> -lz4-1.3.0.jar
> -mail-1.4.7.jar
> -mesos-0.21.1-shaded-protobuf.jar
> -metrics-core-3.1.2.jar
> -metrics-graphite-3.1.2.jar
> -metrics-json-3.1.2.jar
> -metrics-jvm-3.1.2.jar
> -minlog-1.2.jar
> -mx4j-3.0.2.jar
> -netty-3.8.0.Final.jar
> -netty-all-4.0.29.Final.jar
> -objenesis-1.2.jar
> -opencsv-2.3.jar
> -oro-2.0.8.jar
> -paranamer-2.6.jar
> -parquet-column-1.7.0.jar
> -parquet-common-1.7.0.jar
> -parquet-encoding-1.7.0.jar
> -parquet-format-2.3.0-incubating.jar
> -parquet-generator-1.7.0.jar
> -parquet-hadoop-1.7.0.jar
> -parquet-hadoop-bundle-1.6.0.jar
> -parquet-jackson-1.7.0.jar
> -pmml-agent-1.2.7.jar
> -pmml-model-1.2.7.jar
> -pmml-schema-1.2.7.jar
> -protobuf-java-2.5.0.jar
> -py4j-0.9.jar
> -pyrolite-4.9.jar
> -quasiquotes_2.10-2.0.0-M8.jar
> -reflectasm-1.07-shaded.jar
> -scala-compiler-2.10.5.jar
> -scala-library-2.10.5.jar
> -scala-reflect-2.10.5.jar
> -scalap-2.10.5.jar
> -servlet-api-2.5.jar
> -slf4j-api-1.7.10.jar
> -slf4j-log4j12-1.7.10.jar
> -snappy-0.2.jar
> -snappy-java-1.1.2.jar
> -spire-macros_2.10-0.7.4.jar
> -spire_2.10-0.7.4.jar
> -stax-api-1.0-2.jar
> -stax-api-1.0.1.jar
> -stream-2.7.0.jar
> -super-csv-2.2.0.jar
> -tachyon-client-0.8.2.jar
> -tachyon-underfs-hdfs-0.8.2.jar
> -tachyon-underfs-local-0.8.2.jar
> -tachyon-underfs-s3-0.8.2.jar
> -uncommons-maths-1.2.2a.jar
> -unused-1.0.0.jar
> -xbean-asm5-shaded-4.4.jar
> -xercesImpl-2.9.1.jar
> -xmlenc-0.52.jar
> -xz-1.0.jar
> -zookeeper-3.4.6.jar
> +2.10
> +[INFO] --- maven-dependency-plugin
> Using `mvn` from path: /home/ubuntu/workspace/ghprb-spark-multi-conf/build/apache-maven-3.3.3/bin/mvn
> [error] running /home/ubuntu/workspace/ghprb-spark-multi-conf/dev/test-dependencies.sh ; received return code 1
> seems an issue to me...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org