You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2026/09/20 14:19:00 UTC
[jira] [Updated] (SPARK-59674) Fix Comparison method violates its general contract in FIFOSchedulingAlgorithm
[ https://issues.apache.org/jira/browse/SPARK-59674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated SPARK-59674:
-----------------------------------
Labels: pull-request-available (was: )
> Fix Comparison method violates its general contract in FIFOSchedulingAlgorithm
> ------------------------------------------------------------------------------
>
> Key: SPARK-59674
> URL: https://issues.apache.org/jira/browse/SPARK-59674
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 5.0.0
> Reporter: Yuming Wang
> Priority: Major
> Labels: pull-request-available
>
> {noformat}
> java.lang.IllegalArgumentException: Comparison method violates its general contract!
> at java.util.TimSort.mergeHi(TimSort.java:903) ~[?:?]
> at java.util.TimSort.mergeAt(TimSort.java:520) ~[?:?]
> at java.util.TimSort.mergeForceCollapse(TimSort.java:461) ~[?:?]
> at java.util.TimSort.sort(TimSort.java:254) ~[?:?]
> at java.util.Arrays.sort(Arrays.java:1233) ~[?:?]
> at scala.collection.SeqLike.sorted(SeqLike.scala:659) ~[scala-library-2.12.18.jar:?]
> at scala.collection.SeqLike.sorted$(SeqLike.scala:647) ~[scala-library-2.12.18.jar:?]
> at scala.collection.AbstractSeq.sorted(Seq.scala:45) ~[scala-library-2.12.18.jar:?]
> at scala.collection.SeqLike.sortWith(SeqLike.scala:612) ~[scala-library-2.12.18.jar:?]
> at scala.collection.SeqLike.sortWith$(SeqLike.scala:612) ~[scala-library-2.12.18.jar:?]
> at scala.collection.AbstractSeq.sortWith(Seq.scala:45) ~[scala-library-2.12.18.jar:?]
> at org.apache.spark.scheduler.Pool.getSortedTaskSetQueue(Pool.scala:109) ~[spark-core_2.12-3.5.0.jar:3.5.0]
> at org.apache.spark.scheduler.Pool.$anonfun$getSortedTaskSetQueue$2(Pool.scala:111) ~[spark-core_2.12-3.5.0.jar:3.5.0]
> at scala.collection.immutable.Stream.foreach(Stream.scala:533) ~[scala-library-2.12.18.jar:?]
> at org.apache.spark.scheduler.Pool.getSortedTaskSetQueue(Pool.scala:110) ~[spark-core_2.12-3.5.0.jar:3.5.0]
> at org.apache.spark.scheduler.TaskSchedulerImpl.resourceOffers(TaskSchedulerImpl.scala:440) ~[spark-core_2.12-3.5.0.jar:3.5.0]
> at org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint.$anonfun$makeOffers$3(CoarseGrainedSchedulerBackend.scala:428) ~[spark-core_2.12-3.5.0.jar:3.5.0]
> at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.18.jar:?]
> at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659) ~[scala-library-2.12.18.jar:?]
> at scala.util.Success.$anonfun$map$1(Try.scala:255) ~[scala-library-2.12.18.jar:?]
> at scala.util.Success.map(Try.scala:213) ~[scala-library-2.12.18.jar:?]
> at scala.concurrent.Future.$anonfun$map$1(Future.scala:292) ~[scala-library-2.12.18.jar:?]
> at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33) ~[scala-library-2.12.18.jar:?]{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org