[jira] [Closed] (TRAFODION-2091) hdfsFS filesystem usage causies abnormal behavior in Trafodion

["Sandhya Sundaresan (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TRAFODION-2091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sandhya Sundaresan closed TRAFODION-2091.
-----------------------------------------

> hdfsFS filesystem usage causies abnormal  behavior in Trafodion
> ---------------------------------------------------------------
>
>                 Key: TRAFODION-2091
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-2091
>             Project: Apache Trafodion
>          Issue Type: Bug
>          Components: sql-general
>    Affects Versions: 2.1-incubating
>            Reporter: Sandhya Sundaresan
>            Assignee: Sandhya Sundaresan
>            Priority: Major
>
> Several components use the libhdfs API to perform operations on hdfs files in Trafodion. Some places use the JNI API as well to access hdfs. 
> The inconsistency observed was ehen one component cached and kept the hdfsFS hande for it's use another part of the code would perform a "close" or a dsconnect and prematurely close the hdfsFS handle which is currently being used. The reason is that the hdfs layer seems to cache the hdfsFS handle underneathThe solution now is to keep a list of hdfsFS handles at the global context level. All disconnect calls and JNI close calls are remmoved. The hdfHS handles will get cleaned up either at context destructor time or at endSession time. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)