[jira] [Commented] (SPARK-28912) MatchError exception in CheckpointWriteHandler

["Hyukjin Kwon (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920647#comment-16920647 ] 

Hyukjin Kwon commented on SPARK-28912:
--------------------------------------

ping [~avk1]

> MatchError exception in CheckpointWriteHandler
> ----------------------------------------------
>
>                 Key: SPARK-28912
>                 URL: https://issues.apache.org/jira/browse/SPARK-28912
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.3.0, 2.3.2
>            Reporter: Aleksandr Kashkirov
>            Priority: Minor
>
> Setting checkpoint directory name to "checkpoint-" plus some digits (e.g. "checkpoint-01") results in the following error:
> {code:java}
> Exception in thread "pool-32-thread-1" scala.MatchError: 0523a434-0daa-4ea6-a050-c4eb3c557d8c (of class java.lang.String) 
>  at org.apache.spark.streaming.Checkpoint$.org$apache$spark$streaming$Checkpoint$$sortFunc$1(Checkpoint.scala:121) 
>  at org.apache.spark.streaming.Checkpoint$$anonfun$getCheckpointFiles$1.apply(Checkpoint.scala:132) 
>  at org.apache.spark.streaming.Checkpoint$$anonfun$getCheckpointFiles$1.apply(Checkpoint.scala:132) 
>  at scala.math.Ordering$$anon$9.compare(Ordering.scala:200) 
>  at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355) 
>  at java.util.TimSort.sort(TimSort.java:234) 
>  at java.util.Arrays.sort(Arrays.java:1438) 
>  at scala.collection.SeqLike$class.sorted(SeqLike.scala:648) 
>  at scala.collection.mutable.ArrayOps$ofRef.sorted(ArrayOps.scala:186) 
>  at scala.collection.SeqLike$class.sortWith(SeqLike.scala:601) 
>  at scala.collection.mutable.ArrayOps$ofRef.sortWith(ArrayOps.scala:186) 
>  at org.apache.spark.streaming.Checkpoint$.getCheckpointFiles(Checkpoint.scala:132) 
>  at org.apache.spark.streaming.CheckpointWriter$CheckpointWriteHandler.run(Checkpoint.scala:262) 
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
>  at java.lang.Thread.run(Thread.java:748){code}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org