You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by SLiZn Liu <sl...@gmail.com> on 2016/02/11 08:23:03 UTC

Is this Task Scheduler Error normal?

Hi Spark Users,

I’m running Spark jobs on Mesos, and sometimes I get vast number of Task
Scheduler Errors:

ERROR TaskSchedulerImpl: Ignoring update with state FINISHED for TID 1161
because its task set is gone (this is likely the result of receiving
duplicate task finished status updates)T

It looks just a warning message despite begins with ERROR, and do no harm
the eventual result, but I don’t know if these indicates tasks run slower
than usual.
------------------------------

BR,
Todd Leo