You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/10/17 05:36:00 UTC
[jira] [Commented] (HIVE-17825) Socket not closed when trying to
read files to copy over in replication from metadata
[ https://issues.apache.org/jira/browse/HIVE-17825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16207039#comment-16207039 ]
ASF GitHub Bot commented on HIVE-17825:
---------------------------------------
GitHub user anishek opened a pull request:
https://github.com/apache/hive/pull/262
HIVE-17825: Socket not closed when trying to read files to copy over in replication from metadata
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/anishek/hive HIVE-17825
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/262.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #262
----
commit ade76e64ec6180eccf51b12173b73be4a9ca8370
Author: Anishek Agarwal <an...@gmail.com>
Date: 2017-10-17T05:23:35Z
HIVE-17825: Socket not closed when trying to read files to copy over in replication from metadata
----
> Socket not closed when trying to read files to copy over in replication from metadata
> -------------------------------------------------------------------------------------
>
> Key: HIVE-17825
> URL: https://issues.apache.org/jira/browse/HIVE-17825
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.0.0
> Reporter: anishek
> Assignee: anishek
> Priority: Critical
> Labels: pull-request-available
> Fix For: 3.0.0
>
> Attachments: HIVE-17825.0.patch
>
>
> for replication we create a _files in hdfs which lists the source files to be copied over for a table/partition. _files is read in ReplCopyTask to read what files to be copied. The File operations w.r.t to _files is not correct and we leave the files open there, which leads to a lot of CLOSE_WAIT connections to the source Data nodes from HS2 on the replica cluster.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)