[jira] [Commented] (SPARK-19306) Fix inconsistent state in DiskBlockObjectWriter when exception occurred

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-19306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831369#comment-15831369 ] 

Apache Spark commented on SPARK-19306:
--------------------------------------

User 'jerryshao' has created a pull request for this issue:
https://github.com/apache/spark/pull/16657

> Fix inconsistent state in DiskBlockObjectWriter when exception occurred
> -----------------------------------------------------------------------
>
>                 Key: SPARK-19306
>                 URL: https://issues.apache.org/jira/browse/SPARK-19306
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.1.0
>            Reporter: Saisai Shao
>            Priority: Minor
>
> In {{DiskBlockObjectWriter}}, when some errors happened during writing, it will call {{revertPartialWritesAndClose}}, if this method again failed due to some hardware issues like out of disk, it will throw exception without resetting the state of this writer, also skipping the revert. So here propose to fix this issue to offer user a chance to recover from such issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org