You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by pradeepchanumolu <pr...@gmail.com> on 2017/09/19 20:00:44 UTC
Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe,
org.apache.spark:spark-tags
I am hitting this error when I add ignite-spark 2.2.0 artifact to by project.
[error] Modules were resolved with conflicting cross-version suffixes in
{file://ignite-poc/}ignite-poc:
[error] org.scalatest:scalatest _2.11, _2.10
[error] com.twitter:chill _2.11, _2.10
[error] org.apache.spark:spark-unsafe _2.11, _2.10
[error] org.apache.spark:spark-tags _2.11, _2.10
java.lang.RuntimeException: Conflicting cross-version suffixes in:
org.scalatest:scalatest, com.twitter:chill, org.apache.spark:spark-unsafe,
org.apache.spark:spark-tags
at scala.sys.package$.error(package.scala:27)
at
sbt.ConflictWarning$.processCrossVersioned(ConflictWarning.scala:46)
at sbt.ConflictWarning$.apply(ConflictWarning.scala:32)
at sbt.Classpaths$$anonfun$100.apply(Defaults.scala:1300)
at sbt.Classpaths$$anonfun$100.apply(Defaults.scala:1297)
at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
at
sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40)
at sbt.std.Transform$$anon$4.work(System.scala:63)
at
sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228)
at
sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228)
at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17)
at sbt.Execute.work(Execute.scala:237)
at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228)
at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228)
at
sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159)
at sbt.CompletionService$$anon$2.call(CompletionService.scala:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
[error] (*:update) Conflicting cross-version suffixes in:
org.scalatest:scalatest, com.twitter:chill, org.apache.spark:spark-unsafe,
org.apache.spark:spark-tags
After looking at the dependency graph, looks like ignite-spark is depending
on both spark-tags_2.10 and spark-tags_2.11.
[info] | +-org.apache.spark:spark-tags_2.11:2.1.0
[info] | | +-org.scalatest:scalatest_2.11:2.2.6 [S]
[info] | | | +-org.scala-lang.modules:scala-xml_2.11:1.0.2 [S] (evicted
by: 1.0.6)
[info] | | | +-org.scala-lang.modules:scala-xml_2.11:1.0.6 [S]
[info] | | | +-org.scala-lang:scala-reflect:2.11.8 [S]
[info] | | |
[info] | | +-org.spark-project.spark:unused:1.0.0
[info] | |
[info] | +-org.spark-project.spark:unused:1.0.0
[info] |
[info] +-org.apache.spark:spark-tags_2.11:2.1.0
[info] | +-org.scalatest:scalatest_2.11:2.2.6 [S]
[info] | | +-org.scala-lang.modules:scala-xml_2.11:1.0.2 [S] (evicted
by: 1.0.6)
[info] | | +-org.scala-lang.modules:scala-xml_2.11:1.0.6 [S]
[info] | | +-org.scala-lang:scala-reflect:2.11.8 [S]
[info] | |
[info] | +-org.spark-project.spark:unused:1.0.0
[info] |
[info] +-org.apache.spark:spark-unsafe_2.10:2.1.0
[info] | +-com.google.code.findbugs:jsr305:1.3.9
[info] | +-com.twitter:chill_2.10:0.8.0 [S]
[info] | | +-com.esotericsoftware:kryo-shaded:3.0.3
[info] | | | +-com.esotericsoftware:minlog:1.3.0
[info] | | | +-org.objenesis:objenesis:2.1
[info] | | |
[info] | | +-com.twitter:chill-java:0.8.0
[info] | | +-com.esotericsoftware:kryo-shaded:3.0.3
[info] | | +-com.esotericsoftware:minlog:1.3.0
[info] | | +-org.objenesis:objenesis:2.1
[info] | |
[info] | +-org.apache.spark:spark-tags_2.10:2.1.0
[info] | | +-org.scalatest:scalatest_2.10:2.2.6 [S]
[info] | | | +-org.scala-lang:scala-reflect:2.11.8 [S]
[info] | | |
[info] | | +-org.spark-project.spark:unused:1.0.0
[info] | |
[info] | +-org.spark-project.spark:unused:1.0.0
Can someone look into this problem?
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags
Posted by Николай Ижиков <ni...@gmail.com>.
Hello, Denis.
I know about this issue.
I can try to fix it.
But, seems that ticket assigned to you, currently.
Let me know if you need some kind of help.
2017-11-08 18:17 GMT+03:00 Николай Ижиков <ni...@gmail.com>:
> Привет.
>
> Я знаю об этой проблеме. Натолкнулся на неё при реализации Spark DataFrame
> API для Ignite.
> Могу попробовать починить, но баг сейчас на тебе и в In Progress.
>
> Ты его чинишь?
>
>
> 2017-11-08 17:49 GMT+03:00 Denis Mekhanikov <dm...@gmail.com>:
>
>> Igniters,
>>
>> I noticed a problem in POM files of *ignite-spark* and *ignite-spark_2.10*
>> modules.
>>
>> *ignite-spark* is targeted to be used by Scala 2.11, while
>> *ignite-spark_2.10* is made for Scala 2.10.
>> *But, **ignite-spark* has *spark-unsafe_2.10* as a dependency, and
>> *ignite-spark_2.10* depends on *json4s-core_2.11*.
>> It results in that when you add *ignite-spark *module as a dependency to
>> your SBT project, it stops compiling with the following error:
>> Modules were resolved with conflicting cross-version suffixes
>>
>> Nikolay Izhikov, Valentin Kulichenko, can you comment on this? Is it some
>> kind of a hack, or these dependencies are just specified by mistake?
>> There is a ticket for this issue:
>> https://issues.apache.org/jira/browse/IGNITE-6369
>>
>> Denis
>>
>> пт, 6 окт. 2017 г. в 16:44, manuelmourato <ma...@gmail.com>:
>>
>> > Hi, thank you for taking an interest in this bug.
>> > I managed to compile my project successfully by taking Val's suggestion,
>> > changing this:
>> >
>> > <dependency>
>> > <groupId>org.json4s</groupId>
>> > <artifactId>json4s-core_2.10</artifactId>
>> > <version>3.5.0</version>
>> > </dependency>
>> >
>> > I noticed that I couldn't compile using ignite version 2.3, I had to
>> > downgrade to 2.2, otherwise this error would show up:
>> >
>> > [ERROR] Failed to execute goal on project ignite-spark_2.10: Could not
>> > resolve dependencies for project
>> > org.apache.ignite:ignite-spark_2.10:jar:2.3.0-SNAPSHOT: The following
>> > artifacts could not be resolved:
>> > org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT,
>> > org.apache.ignite:ignite-core:jar:tests:2.3.0-SNAPSHOT,
>> > org.apache.ignite:ignite-indexing:jar:2.3.0-SNAPSHOT: Could not find
>> > artifact org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT in
>> > h2database.com
>> > (http://h2database.com/m2-repo) -> [Help 1]
>> >
>> > Maybe it's worth taking a look.
>> > Cheers.
>> >
>> > --ManuelMourato
>> >
>> >
>> >
>> > --
>> > Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>> >
>>
>
>
>
> --
> Nikolay Izhikov
> NIzhikov.dev@gmail.com
>
--
Nikolay Izhikov
NIzhikov.dev@gmail.com
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags
Posted by Denis Mekhanikov <dm...@gmail.com>.
Igniters,
I noticed a problem in POM files of *ignite-spark* and *ignite-spark_2.10*
modules.
*ignite-spark* is targeted to be used by Scala 2.11, while
*ignite-spark_2.10* is made for Scala 2.10.
*But, **ignite-spark* has *spark-unsafe_2.10* as a dependency, and
*ignite-spark_2.10* depends on *json4s-core_2.11*.
It results in that when you add *ignite-spark *module as a dependency to
your SBT project, it stops compiling with the following error:
Modules were resolved with conflicting cross-version suffixes
Nikolay Izhikov, Valentin Kulichenko, can you comment on this? Is it some
kind of a hack, or these dependencies are just specified by mistake?
There is a ticket for this issue:
https://issues.apache.org/jira/browse/IGNITE-6369
Denis
пт, 6 окт. 2017 г. в 16:44, manuelmourato <ma...@gmail.com>:
> Hi, thank you for taking an interest in this bug.
> I managed to compile my project successfully by taking Val's suggestion,
> changing this:
>
> <dependency>
> <groupId>org.json4s</groupId>
> <artifactId>json4s-core_2.10</artifactId>
> <version>3.5.0</version>
> </dependency>
>
> I noticed that I couldn't compile using ignite version 2.3, I had to
> downgrade to 2.2, otherwise this error would show up:
>
> [ERROR] Failed to execute goal on project ignite-spark_2.10: Could not
> resolve dependencies for project
> org.apache.ignite:ignite-spark_2.10:jar:2.3.0-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT,
> org.apache.ignite:ignite-core:jar:tests:2.3.0-SNAPSHOT,
> org.apache.ignite:ignite-indexing:jar:2.3.0-SNAPSHOT: Could not find
> artifact org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT in
> h2database.com
> (http://h2database.com/m2-repo) -> [Help 1]
>
> Maybe it's worth taking a look.
> Cheers.
>
> --ManuelMourato
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe,
org.apache.spark:spark-tags
Posted by manuelmourato <ma...@gmail.com>.
Hi, thank you for taking an interest in this bug.
I managed to compile my project successfully by taking Val's suggestion,
changing this:
<dependency>
<groupId>org.json4s</groupId>
<artifactId>json4s-core_2.10</artifactId>
<version>3.5.0</version>
</dependency>
I noticed that I couldn't compile using ignite version 2.3, I had to
downgrade to 2.2, otherwise this error would show up:
[ERROR] Failed to execute goal on project ignite-spark_2.10: Could not
resolve dependencies for project
org.apache.ignite:ignite-spark_2.10:jar:2.3.0-SNAPSHOT: The following
artifacts could not be resolved:
org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT,
org.apache.ignite:ignite-core:jar:tests:2.3.0-SNAPSHOT,
org.apache.ignite:ignite-indexing:jar:2.3.0-SNAPSHOT: Could not find
artifact org.apache.ignite:ignite-core:jar:2.3.0-SNAPSHOT in h2database.com
(http://h2database.com/m2-repo) -> [Help 1]
Maybe it's worth taking a look.
Cheers.
--ManuelMourato
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags
Posted by Denis Magda <dm...@apache.org>.
Nikolay I. please chime in as the one who actively works with Ignite Spark integration.
—
Denis
> On Oct 5, 2017, at 5:47 PM, Valentin Kulichenko <va...@gmail.com> wrote:
>
> +dev list
>
> Igniters,
>
> I'm looking at this and it seems to be a bug. We have this dependency in spark-2.10 module POM:
>
> <dependency>
> <groupId>org.json4s</groupId>
> <artifactId>json4s-core_2.11</artifactId>
> <version>3.5.0</version>
> </dependency>
>
> Would replacing it with json4s-core_2.10 be enough to fix?
>
> -Val
>
> On Thu, Oct 5, 2017 at 5:16 PM, manuelmourato <manuelmourato25@gmail.com <ma...@gmail.com>> wrote:
> Hey,
> I tried using vkulichenko approach with scala 2.10 dependencies:
>
> name := "App"
>
> version := "1.0"
>
> scalaVersion := "2.10.6"
>
>
> libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "2.2.0"
> % "provided"
> libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.10"
> % "2.2.0" % "provided"
> libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
> libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
>
> But I still got a cross-version suffixes error, this time for the following
> dependencies:
>
> [error] org.json4s:json4s-ast _2.10, _2.11
> [error] org.json4s:json4s-core _2.10, _2.11
> java.lang.RuntimeException: Conflicting cross-version suffixes in:
> org.json4s:json4s-ast, org.json4s:json4s-core
>
> Any ideas on how to solve this?
>
> -ManuelMourato
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ <http://apache-ignite-users.70518.x6.nabble.com/>
>
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags
Posted by Denis Magda <dm...@apache.org>.
Nikolay I. please chime in as the one who actively works with Ignite Spark integration.
—
Denis
> On Oct 5, 2017, at 5:47 PM, Valentin Kulichenko <va...@gmail.com> wrote:
>
> +dev list
>
> Igniters,
>
> I'm looking at this and it seems to be a bug. We have this dependency in spark-2.10 module POM:
>
> <dependency>
> <groupId>org.json4s</groupId>
> <artifactId>json4s-core_2.11</artifactId>
> <version>3.5.0</version>
> </dependency>
>
> Would replacing it with json4s-core_2.10 be enough to fix?
>
> -Val
>
> On Thu, Oct 5, 2017 at 5:16 PM, manuelmourato <manuelmourato25@gmail.com <ma...@gmail.com>> wrote:
> Hey,
> I tried using vkulichenko approach with scala 2.10 dependencies:
>
> name := "App"
>
> version := "1.0"
>
> scalaVersion := "2.10.6"
>
>
> libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "2.2.0"
> % "provided"
> libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.10"
> % "2.2.0" % "provided"
> libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
> libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
>
> But I still got a cross-version suffixes error, this time for the following
> dependencies:
>
> [error] org.json4s:json4s-ast _2.10, _2.11
> [error] org.json4s:json4s-core _2.10, _2.11
> java.lang.RuntimeException: Conflicting cross-version suffixes in:
> org.json4s:json4s-ast, org.json4s:json4s-core
>
> Any ideas on how to solve this?
>
> -ManuelMourato
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ <http://apache-ignite-users.70518.x6.nabble.com/>
>
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags
Posted by Valentin Kulichenko <va...@gmail.com>.
+dev list
Igniters,
I'm looking at this and it seems to be a bug. We have this dependency in
spark-2.10 module POM:
<dependency>
<groupId>org.json4s</groupId>
<artifactId>json4s-core_2.11</artifactId>
<version>3.5.0</version>
</dependency>
Would replacing it with json4s-core_2.10 be enough to fix?
-Val
On Thu, Oct 5, 2017 at 5:16 PM, manuelmourato <ma...@gmail.com>
wrote:
> Hey,
> I tried using vkulichenko approach with scala 2.10 dependencies:
>
> name := "App"
>
> version := "1.0"
>
> scalaVersion := "2.10.6"
>
>
> libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" %
> "2.2.0"
> % "provided"
> libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.
> 10"
> % "2.2.0" % "provided"
> libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
> libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
>
> But I still got a cross-version suffixes error, this time for the following
> dependencies:
>
> [error] org.json4s:json4s-ast _2.10, _2.11
> [error] org.json4s:json4s-core _2.10, _2.11
> java.lang.RuntimeException: Conflicting cross-version suffixes in:
> org.json4s:json4s-ast, org.json4s:json4s-core
>
> Any ideas on how to solve this?
>
> -ManuelMourato
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags
Posted by Valentin Kulichenko <va...@gmail.com>.
+dev list
Igniters,
I'm looking at this and it seems to be a bug. We have this dependency in
spark-2.10 module POM:
<dependency>
<groupId>org.json4s</groupId>
<artifactId>json4s-core_2.11</artifactId>
<version>3.5.0</version>
</dependency>
Would replacing it with json4s-core_2.10 be enough to fix?
-Val
On Thu, Oct 5, 2017 at 5:16 PM, manuelmourato <ma...@gmail.com>
wrote:
> Hey,
> I tried using vkulichenko approach with scala 2.10 dependencies:
>
> name := "App"
>
> version := "1.0"
>
> scalaVersion := "2.10.6"
>
>
> libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" %
> "2.2.0"
> % "provided"
> libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
> "provided"
> libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.
> 10"
> % "2.2.0" % "provided"
> libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
> libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
>
> But I still got a cross-version suffixes error, this time for the following
> dependencies:
>
> [error] org.json4s:json4s-ast _2.10, _2.11
> [error] org.json4s:json4s-core _2.10, _2.11
> java.lang.RuntimeException: Conflicting cross-version suffixes in:
> org.json4s:json4s-ast, org.json4s:json4s-core
>
> Any ideas on how to solve this?
>
> -ManuelMourato
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe,
org.apache.spark:spark-tags
Posted by manuelmourato <ma...@gmail.com>.
Hey,
I tried using vkulichenko approach with scala 2.10 dependencies:
name := "App"
version := "1.0"
scalaVersion := "2.10.6"
libraryDependencies += "org.apache.spark" % "spark-core_2.10" % "2.2.0" %
"provided"
libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "2.2.0"
% "provided"
libraryDependencies += "org.apache.spark" % "spark-sql_2.10" % "2.2.0" %
"provided"
libraryDependencies += "org.apache.spark" % "spark-mllib_2.10" % "2.2.0" %
"provided"
libraryDependencies += "org.xerial.snappy" % "snappy-java" % "1.1.4"
libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-8_2.10"
% "2.2.0" % "provided"
libraryDependencies += "org.apache.ignite" % "ignite-spark_2.10" % "2.2.0"
libraryDependencies += "org.apache.ignite" % "ignite-spring" % "2.2.0"
But I still got a cross-version suffixes error, this time for the following
dependencies:
[error] org.json4s:json4s-ast _2.10, _2.11
[error] org.json4s:json4s-core _2.10, _2.11
java.lang.RuntimeException: Conflicting cross-version suffixes in:
org.json4s:json4s-ast, org.json4s:json4s-core
Any ideas on how to solve this?
-ManuelMourato
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Conflicting cross-version suffixes in: org.scalatest:scalatest,
com.twitter:chill, org.apache.spark:spark-unsafe,
org.apache.spark:spark-tags
Posted by vkulichenko <va...@gmail.com>.
Looks like you use Scala 2.10 and corresponding Spark libraries. In this case
you should use 'ignite-spark_2.10' Ignite module instead of just
'ignite-spark'.
-Val
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/