You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2014/04/03 02:56:16 UTC

[jira] [Created] (SPARK-1400) Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more

Tathagata Das created SPARK-1400:
------------------------------------

             Summary: Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more
                 Key: SPARK-1400
                 URL: https://issues.apache.org/jira/browse/SPARK-1400
             Project: Spark
          Issue Type: Bug
          Components: Streaming
    Affects Versions: 0.9.0
            Reporter: Tathagata Das


Spark Streaming generates BlockRDDs with the data received over the network. These data blocks are not automatically cleared, they spill over from memory based on LRU, which slows down processing.



--
This message was sent by Atlassian JIRA
(v6.2#6252)