You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2019/09/07 00:59:00 UTC
[jira] [Assigned] (SPARK-28912) MatchError exception in
CheckpointWriteHandler
[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun reassigned SPARK-28912:
-------------------------------------
Assignee: Aleksandr Kashkirov
> MatchError exception in CheckpointWriteHandler
> ----------------------------------------------
>
> Key: SPARK-28912
> URL: https://issues.apache.org/jira/browse/SPARK-28912
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.0, 2.3.2, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.4.4
> Reporter: Aleksandr Kashkirov
> Assignee: Aleksandr Kashkirov
> Priority: Minor
> Fix For: 2.4.5, 3.0.0
>
>
> Setting checkpoint directory name to "checkpoint-" plus some digits (e.g. "checkpoint-01") results in the following error:
> {code:java}
> Exception in thread "pool-32-thread-1" scala.MatchError: 0523a434-0daa-4ea6-a050-c4eb3c557d8c (of class java.lang.String)
> at org.apache.spark.streaming.Checkpoint$.org$apache$spark$streaming$Checkpoint$$sortFunc$1(Checkpoint.scala:121)
> at org.apache.spark.streaming.Checkpoint$$anonfun$getCheckpointFiles$1.apply(Checkpoint.scala:132)
> at org.apache.spark.streaming.Checkpoint$$anonfun$getCheckpointFiles$1.apply(Checkpoint.scala:132)
> at scala.math.Ordering$$anon$9.compare(Ordering.scala:200)
> at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355)
> at java.util.TimSort.sort(TimSort.java:234)
> at java.util.Arrays.sort(Arrays.java:1438)
> at scala.collection.SeqLike$class.sorted(SeqLike.scala:648)
> at scala.collection.mutable.ArrayOps$ofRef.sorted(ArrayOps.scala:186)
> at scala.collection.SeqLike$class.sortWith(SeqLike.scala:601)
> at scala.collection.mutable.ArrayOps$ofRef.sortWith(ArrayOps.scala:186)
> at org.apache.spark.streaming.Checkpoint$.getCheckpointFiles(Checkpoint.scala:132)
> at org.apache.spark.streaming.CheckpointWriter$CheckpointWriteHandler.run(Checkpoint.scala:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748){code}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org