You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2017/01/20 07:50:26 UTC

[jira] [Created] (SPARK-19306) Fix inconsistent state in DiskBlockObjectWrite when exception occurred

Saisai Shao created SPARK-19306:
-----------------------------------

             Summary: Fix inconsistent state in DiskBlockObjectWrite when exception occurred
                 Key: SPARK-19306
                 URL: https://issues.apache.org/jira/browse/SPARK-19306
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.1.0
            Reporter: Saisai Shao
            Priority: Minor


In {{DiskBlockObjectWriter}}, when some errors happened during writing, it will call {{revertPartialWritesAndClose}}, if this method again failed due to some hardware issues like out of disk, it will throw exception without resetting the state of this writer, also skipping the revert. So here propose to fix this issue to offer user a chance to recover from such issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org