You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Holger Fleischmann (JIRA)" <ji...@apache.org> on 2018/12/19 09:30:00 UTC
[jira] [Updated] (AVRO-2286) DataFileReader leaks file descriptor
on exception during construction
[ https://issues.apache.org/jira/browse/AVRO-2286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Holger Fleischmann updated AVRO-2286:
-------------------------------------
Description:
The constructor {{DataFileReader(File, DatumReader)}} does not close the already opened file again when it throws an exception. This leads to a leaked file descriptor and especially to not being able to delete the still open invalid file then (at least on Windows).
This case is important when Avro files may be truncated on write, e.g. due to a hard shutdown, and the application must be able to recover from such a situation on the next restart.
Please see the attached file {{DataFileReaderCloseBug.java}} to reproduce the problem.
I did not find that problem in Jira/mailing lists. Thanks for your help in advance :)
was:
The constructor {{DataFileReader(File, DatumReader)}} does not close the already opened file again when it throws an exception. This leads to a leaked file descriptor and especially to not being able to delete the still open invalid file then.
This case is important when Avro files may be truncated on write, e.g. due to a hard shutdown, and the application must be able to recover from such a situation on the next restart.
Please see the attached file {{DataFileReaderCloseBug.java}} to reproduce the problem.
I did not find that problem in Jira/mailing lists. Thanks for your help in advance :)
> DataFileReader leaks file descriptor on exception during construction
> ---------------------------------------------------------------------
>
> Key: AVRO-2286
> URL: https://issues.apache.org/jira/browse/AVRO-2286
> Project: Apache Avro
> Issue Type: Bug
> Components: java
> Affects Versions: 1.8.2
> Reporter: Holger Fleischmann
> Priority: Major
> Attachments: DataFileReaderCloseBug.java
>
>
> The constructor {{DataFileReader(File, DatumReader)}} does not close the already opened file again when it throws an exception. This leads to a leaked file descriptor and especially to not being able to delete the still open invalid file then (at least on Windows).
> This case is important when Avro files may be truncated on write, e.g. due to a hard shutdown, and the application must be able to recover from such a situation on the next restart.
> Please see the attached file {{DataFileReaderCloseBug.java}} to reproduce the problem.
> I did not find that problem in Jira/mailing lists. Thanks for your help in advance :)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)