You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/06/29 01:11:00 UTC

[jira] [Commented] (ORC-525) Users must close Readers in ORC 1.5.6

    [ https://issues.apache.org/jira/browse/ORC-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875334#comment-16875334 ] 

Dongjoon Hyun commented on ORC-525:
-----------------------------------

[~owen.omalley]. Why do we enforce such a behavior change at bug fix release from 1.5.5 to 1.5.6?

> Users must close Readers in ORC 1.5.6
> -------------------------------------
>
>                 Key: ORC-525
>                 URL: https://issues.apache.org/jira/browse/ORC-525
>             Project: ORC
>          Issue Type: Bug
>          Components: Java
>    Affects Versions: 1.5.6
>            Reporter: Dongjoon Hyun
>            Assignee: Owen O'Malley
>            Priority: Major
>
> Unlike 1.5.5, ORC 1.5.6-rc1 seems to have a following issue which causes Apache Spark unit test failures.
> {code}
> $ build/sbt "sql/testOnly *.SQLQuerySuite"
> ...
> [info]   Cause: java.lang.Throwable:
> [info]   at org.apache.spark.DebugFilesystem$.addOpenStream(DebugFilesystem.scala:36)
> [info]   at org.apache.spark.DebugFilesystem.open(DebugFilesystem.scala:70)
> [info]   at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769)
> [info]   at org.apache.orc.impl.ReaderImpl.extractFileTail(ReaderImpl.java:535)
> [info]   at org.apache.orc.impl.ReaderImpl.<init>(ReaderImpl.java:368)
> [info]   at org.apache.orc.OrcFile.createReader(OrcFile.java:343)
> {code}
> ORC-498 (ReaderImpl and RecordReaderImpl open separate file handles) seems to be the reason of this change.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)