You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/27 05:15:01 UTC
[jira] [Commented] (HIVE-17825) Socket not closed when trying to
read files to copy over in replication from metadata
[ https://issues.apache.org/jira/browse/HIVE-17825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16559266#comment-16559266 ]
ASF GitHub Bot commented on HIVE-17825:
---------------------------------------
Github user anishek closed the pull request at:
https://github.com/apache/hive/pull/262
> Socket not closed when trying to read files to copy over in replication from metadata
> -------------------------------------------------------------------------------------
>
> Key: HIVE-17825
> URL: https://issues.apache.org/jira/browse/HIVE-17825
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.0.0
> Reporter: anishek
> Assignee: anishek
> Priority: Critical
> Labels: pull-request-available
> Fix For: 3.0.0
>
> Attachments: HIVE-17825.0.patch
>
>
> for replication we create a _files in hdfs which lists the source files to be copied over for a table/partition. _files is read in ReplCopyTask to read what files to be copied. The File operations w.r.t to _files is not correct and we leave the files open there, which leads to a lot of CLOSE_WAIT connections to the source Data nodes from HS2 on the replica cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)