You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/09/16 19:21:33 UTC
[jira] [Commented] (SPARK-3539) Task description "apply at
Option.scala:120"; no user code involved
[ https://issues.apache.org/jira/browse/SPARK-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135755#comment-14135755 ]
Patrick Wendell commented on SPARK-3539:
----------------------------------------
could you describe in more detail what you mean here? What do you mean by callbacks?
> Task description "apply at Option.scala:120"; no user code involved
> -------------------------------------------------------------------
>
> Key: SPARK-3539
> URL: https://issues.apache.org/jira/browse/SPARK-3539
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.1.0
> Reporter: John Salvatier
> Priority: Minor
>
> In Spark 1.1, I'm seeing tasks with callbacks that don't involve my code at all!
> I'd seen something like this before in 1.0.0, but the behavior seems to be back
> apply at Option.scala:120
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:202)
> scala.Option.getOrElse(Option.scala:120)
> org.apache.spark.rdd.RDD.partitions(RDD.scala:202)
> org.apache.spark.rdd.FilteredRDD.getPartitions(FilteredRDD.scala:29)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:204)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:202)
> scala.Option.getOrElse(Option.scala:120)
> org.apache.spark.rdd.RDD.partitions(RDD.scala:202)
> org.apache.spark.rdd.MappedRDD.getPartitions(MappedRDD.scala:28)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:204)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:202)
> scala.Option.getOrElse(Option.scala:120)
> org.apache.spark.rdd.RDD.partitions(RDD.scala:202)
> org.apache.spark.rdd.FilteredRDD.getPartitions(FilteredRDD.scala:29)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:204)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:202)
> scala.Option.getOrElse(Option.scala:120)
> org.apache.spark.rdd.RDD.partitions(RDD.scala:202)
> org.apache.spark.rdd.MappedRDD.getPartitions(MappedRDD.scala:28)
> org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:204)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org