You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2017/01/20 08:00:36 UTC

[jira] [Updated] (SPARK-19306) Fix inconsistent state in DiskBlockObjectWriter when exception occurred

     [ https://issues.apache.org/jira/browse/SPARK-19306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Saisai Shao updated SPARK-19306:
--------------------------------
    Summary: Fix inconsistent state in DiskBlockObjectWriter when exception occurred  (was: Fix inconsistent state in DiskBlockObjectWrite when exception occurred)

> Fix inconsistent state in DiskBlockObjectWriter when exception occurred
> -----------------------------------------------------------------------
>
>                 Key: SPARK-19306
>                 URL: https://issues.apache.org/jira/browse/SPARK-19306
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.1.0
>            Reporter: Saisai Shao
>            Priority: Minor
>
> In {{DiskBlockObjectWriter}}, when some errors happened during writing, it will call {{revertPartialWritesAndClose}}, if this method again failed due to some hardware issues like out of disk, it will throw exception without resetting the state of this writer, also skipping the revert. So here propose to fix this issue to offer user a chance to recover from such issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org