You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/04/24 14:32:00 UTC
[jira] [Resolved] (SPARK-27550) Fix `test-dependencies.sh` not to
use `kafka-0-8` profile for Scala-2.12
[ https://issues.apache.org/jira/browse/SPARK-27550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-27550.
-----------------------------------
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 2.4.3
This is resolved via https://github.com/apache/spark/pull/24445
> Fix `test-dependencies.sh` not to use `kafka-0-8` profile for Scala-2.12
> ------------------------------------------------------------------------
>
> Key: SPARK-27550
> URL: https://issues.apache.org/jira/browse/SPARK-27550
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 2.4.3
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Minor
> Fix For: 2.4.3
>
>
> Since SPARK-27274 deprecated Scala-2.11 at Spark 2.4.1, we need to test Scala-2.12 more.
> Kakfa 0.8 doesn't have Scala-2.12 artifacts, e.g., `org.apache.kafka:kafka_2.12:jar:0.8.2.1`. This issue aims to fix `test-dependencies.sh` script to understand Scala binary version.
> {code:java}
> $ dev/change-scala-version.sh 2.12
> $ dev/test-dependencies.sh
> Using `mvn` from path: /usr/local/bin/mvn
> Using `mvn` from path: /usr/local/bin/mvn
> Performing Maven install for hadoop-2.6
> Using `mvn` from path: /usr/local/bin/mvn
> [ERROR] Failed to execute goal on project spark-streaming-kafka-0-8_2.12: Could not resolve dependencies for project org.apache.spark:spark-streaming-kafka-0-8_2.12:jar:spark-335572: Could not find artifact org.apache.kafka:kafka_2.12:jar:0.8.2.1 in central (https://repo.maven.apache.org/maven2) -> [Help 1]
> {code}
> Please note that this issue doesn't aim to update `spark-deps-hadoop-2.6` manifest here.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org