You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Patrick Gomes <go...@gmail.com> on 2017/04/13 14:10:53 UTC

Fwd: ERROR Dropping SparkListenerEvent

Hey all,

I was wondering if anyone could point me where to start debugging the
following error:

ERROR Dropping SparkListenerEvent because no remaining room in event
queue. This likely means one of the SparkListeners is too slow and
cannot keep up with the rate at which tasks are being started by the
scheduler.

This happens when I call the fit method of Count Vectorizer on a fairly
small dataset (< 20 GB).

Running on a cluster with 5 nodes (c3.8xlarge), Spark 2.1, and Hadoop 2.7.
If there is anything else that would be helpful to know just let me know
and I can include it.

Best,
Patrick