You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2014/10/25 06:03:33 UTC

[jira] [Commented] (SPARK-4028) ReceivedBlockHandler interface to abstract the functionality of storage of received data

    [ https://issues.apache.org/jira/browse/SPARK-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183908#comment-14183908 ] 

Apache Spark commented on SPARK-4028:
-------------------------------------

User 'tdas' has created a pull request for this issue:
https://github.com/apache/spark/pull/2940

> ReceivedBlockHandler interface to abstract the functionality of storage of received data
> ----------------------------------------------------------------------------------------
>
>                 Key: SPARK-4028
>                 URL: https://issues.apache.org/jira/browse/SPARK-4028
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Streaming
>            Reporter: Tathagata Das
>            Assignee: Tathagata Das
>            Priority: Critical
>
> As part of the initiative to prevent data loss on streaming driver failure, this JIRA tracks the subtask of implementing a ReceivedBlockHandler, that abstracts the functionality of storage of received data blocks. The default implementation will maintain the current behavior of storing the data into BlockManager. The optional implementation will store the data to both BlockManager as well as a write ahead log. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org