You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Jan-Paul Bultmann <ja...@me.com> on 2015/07/08 17:22:23 UTC

Jobs with unknown origin.

Hey,

I have quite a few jobs appearing in the web-ui with the description "run at ThreadPoolExecutor.java:1142".
Are these generated by SparkSQL internally?

There are so many that they cause a RejectedExecutionException when the thread-pool runs out of space for them.

RejectedExecutionException Task scala.concurrent.impl.Future$PromiseCompletingRunnable@30ec07a4 rejected from java.util.concurrent.ThreadPoolExecutor@9110d1[Running, pool size = 128, active threads = 128, queued tasks = 0, completed tasks = 392]  java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution (ThreadPoolExecutor.java:2047)

Any ideas where they come from? I'm pretty sure that they don't originate from my code.

Cheers Jan
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org